Skip to content

perf: remove implicit ListViewArray rebuild during take and filter operations#8048

Open
mhk197 wants to merge 14 commits into
developfrom
mk/explicit-listview-compaction
Open

perf: remove implicit ListViewArray rebuild during take and filter operations#8048
mhk197 wants to merge 14 commits into
developfrom
mk/explicit-listview-compaction

Conversation

@mhk197
Copy link
Copy Markdown

@mhk197 mhk197 commented May 21, 2026

Summary

Removes implicit rebuilds from ListViewArray take and filter compute kernels, adds density-introspection methods to support deciding when to rebuild explicitly at materialization boundaries, and defers rebuilding until array export.

Motivation. The previous code rebuilt the elements buffer eagerly on every take or filter whose row-fraction dropped below REBUILD_DENSITY_THRESHOLD. In an execution tree like take → take → ..., an eager mid-pipeline rebuild costs an allocation and a full copy of referenced ranges that the next operator may immediately sparsify away.

The row-fraction heuristic was also inaccurate. It doesn't account for per-row size variance, unreferenced elements, and duplicate references.

Changes:

  • Drop implicit rebuild from TakeReduce::take and TakeExecute::take
  • Drop implicit rebuild from filter_listview
  • Add methods to calculate reference density: compute_referenced_elements_mask, compute_density, and estimate_density
  • Add ListViewArray::should_rebuild(exact: bool): Currently unused but intended to gate an explicit compaction boundary in follow-up.

API Changes

take/filter over a sparse or low-density ListViewArray no longer allocates a compacted elements buffer. Downstream consumers must call rebuild and should_rebuild explicitly themselves.

Testing

  • New vortex-array/src/arrays/listview/tests/density.rs with multiple tests:

@mhk197 mhk197 requested a review from a team May 21, 2026 14:08
@mhk197 mhk197 marked this pull request as draft May 21, 2026 14:08
@mhk197 mhk197 added the action/benchmark Trigger full benchmarks to run on this PR label May 21, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 21, 2026
@connortsui20 connortsui20 self-requested a review May 21, 2026 14:10
@mhk197 mhk197 changed the title fix: remove implicit ListViewArray rebuild during take and filter operations perf: remove implicit ListViewArray rebuild during take and filter operations May 21, 2026
@mhk197 mhk197 force-pushed the mk/explicit-listview-compaction branch from c6a1940 to 95ae305 Compare May 21, 2026 14:16
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 21, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done c6a1940 1 Explore Profiling Data

Powered by Polar Signals Cloud

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 21, 2026

Merging this PR will improve performance by 19.67%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 1236 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 225.1 µs 188.1 µs +19.67%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing mk/explicit-listview-compaction (cd7c97e) with develop (f852d72)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.052x ➖


datafusion / vortex-file-compressed (1.052x ➖, 0↑ 2↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 121797554 117844011 1.03
polarsignals_q01/datafusion:vortex-file-compressed 276020276 298014158 0.93
polarsignals_q02/datafusion:vortex-file-compressed 25139908 24248438 1.04
polarsignals_q03/datafusion:vortex-file-compressed 🚨 310585165 280903187 1.11
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13054158 11474748 1.14
polarsignals_q05/datafusion:vortex-file-compressed 17556370 15974570 1.10
polarsignals_q06/datafusion:vortex-file-compressed 19624451 18237482 1.08
polarsignals_q07/datafusion:vortex-file-compressed 15014404 13720876 1.09
polarsignals_q08/datafusion:vortex-file-compressed 442578613 414022487 1.07
polarsignals_q09/datafusion:vortex-file-compressed 11742485 12166323 0.97

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.41 MB 689.41 MB 32 B -0.0%

Totals:

  • vortex-file-compressed: 689.41 MB → 689.41 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 0.938x ➖
Parquet (geomean): 0.931x ➖
Shifts: Parquet (control) -6.9% · Median polish -5.7%


datafusion / vortex-file-compressed (0.927x ➖, 2↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4970125 6038841 0.82
fineweb_q01/datafusion:vortex-file-compressed 🚀 18127915 21652690 0.84
fineweb_q02/datafusion:vortex-file-compressed 22990823 24521622 0.94
fineweb_q03/datafusion:vortex-file-compressed 79740621 78802566 1.01
fineweb_q04/datafusion:vortex-file-compressed 228187877 234452864 0.97
fineweb_q05/datafusion:vortex-file-compressed 217150248 220045452 0.99
fineweb_q06/datafusion:vortex-file-compressed 51301324 54637855 0.94
fineweb_q07/datafusion:vortex-file-compressed 58726839 62629084 0.94
fineweb_q08/datafusion:vortex-file-compressed 20881549 22740641 0.92
datafusion / vortex-compact (0.928x ➖, 3↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5757414 6745005 0.85
fineweb_q01/datafusion:vortex-compact 🚀 90562565 102709752 0.88
fineweb_q02/datafusion:vortex-compact 102158102 105317885 0.97
fineweb_q03/datafusion:vortex-compact 869460999 891082092 0.98
fineweb_q04/datafusion:vortex-compact 912649070 962397358 0.95
fineweb_q05/datafusion:vortex-compact 811327050 863733234 0.94
fineweb_q06/datafusion:vortex-compact 463464258 479438827 0.97
fineweb_q07/datafusion:vortex-compact 470441416 494435303 0.95
fineweb_q08/datafusion:vortex-compact 🚀 17450279 19917960 0.88
datafusion / parquet (0.926x ➖, 2↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6778765 7605681 0.89
fineweb_q01/datafusion:parquet 290929304 316172285 0.92
fineweb_q02/datafusion:parquet 291514812 308991803 0.94
fineweb_q03/datafusion:parquet 286028106 304571947 0.94
fineweb_q04/datafusion:parquet 306785892 321541326 0.95
fineweb_q05/datafusion:parquet 🚀 299185335 343728216 0.87
fineweb_q06/datafusion:parquet 288458644 302936437 0.95
fineweb_q07/datafusion:parquet 281512645 303279998 0.93
fineweb_q08/datafusion:parquet 279325053 296850696 0.94
duckdb / vortex-file-compressed (0.925x ➖, 3↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3797912 4662584 0.81
fineweb_q01/duckdb:vortex-file-compressed 22995606 23874676 0.96
fineweb_q02/duckdb:vortex-file-compressed 24631382 25041548 0.98
fineweb_q03/duckdb:vortex-file-compressed 125178804 137872698 0.91
fineweb_q04/duckdb:vortex-file-compressed 222259998 224248001 0.99
fineweb_q05/duckdb:vortex-file-compressed 211889169 214026908 0.99
fineweb_q06/duckdb:vortex-file-compressed 🚀 51546109 57755321 0.89
fineweb_q07/duckdb:vortex-file-compressed 55438693 58527951 0.95
fineweb_q08/duckdb:vortex-file-compressed 🚀 22624563 26433559 0.86
duckdb / vortex-compact (0.972x ➖, 1↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 4166391 4673143 0.89
fineweb_q01/duckdb:vortex-compact 105404849 102050169 1.03
fineweb_q02/duckdb:vortex-compact 110945030 113841553 0.97
fineweb_q03/duckdb:vortex-compact 846179681 896561802 0.94
fineweb_q04/duckdb:vortex-compact 894734681 936736184 0.96
fineweb_q05/duckdb:vortex-compact 801061861 819432022 0.98
fineweb_q06/duckdb:vortex-compact 463073225 468769880 0.99
fineweb_q07/duckdb:vortex-compact 477313301 483832230 0.99
fineweb_q08/duckdb:vortex-compact 19885989 19811187 1.00
duckdb / parquet (0.936x ➖, 1↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31271335 33389911 0.94
fineweb_q01/duckdb:parquet 83869203 90879068 0.92
fineweb_q02/duckdb:parquet 84836049 90874674 0.93
fineweb_q03/duckdb:parquet 315913307 336123624 0.94
fineweb_q04/duckdb:parquet 445671271 463427373 0.96
fineweb_q05/duckdb:parquet 414426915 426738527 0.97
fineweb_q06/duckdb:parquet 203513346 211737610 0.96
fineweb_q07/duckdb:parquet 217497585 227474597 0.96
fineweb_q08/duckdb:parquet 🚀 34298104 40356641 0.85
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -14.6% -8.6% -6.6% +47.1% ➖ noise
0 datafusion:vortex-file-compressed -17.7% -8.6% -9.9% +55.0% ➖ noise
0 duckdb:vortex-compact -10.8% -8.6% -2.4% +45.9% ➖ noise
0 duckdb:vortex-file-compressed -18.5% -8.6% -10.8% +72.7% ➖ noise
1 datafusion:vortex-compact -11.8% -7.8% -4.3% +19.1% ➖ noise
1 datafusion:vortex-file-compressed -16.3% -7.8% -9.1% +15.8% ➖ noise
1 duckdb:vortex-compact +3.3% -7.8% +12.1% +13.8% ➖ noise
1 duckdb:vortex-file-compressed -3.7% -7.8% +4.5% +70.1% ➖ noise
2 datafusion:vortex-compact -3.0% -6.2% +3.4% +13.2% ➖ noise
2 datafusion:vortex-file-compressed -6.2% -6.2% -0.1% +14.0% ➖ noise
2 duckdb:vortex-compact -2.5% -6.2% +3.8% +10.8% ➖ noise
2 duckdb:vortex-file-compressed -1.6% -6.2% +4.8% +10.0% ➖ noise
3 datafusion:vortex-compact -2.4% -6.1% +3.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.2% -6.1% +7.7% +18.0% ➖ noise
3 duckdb:vortex-compact -5.6% -6.1% +0.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -9.2% -6.1% -3.4% +29.1% ➖ noise
4 datafusion:vortex-compact -5.2% -4.2% -1.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.7% -4.2% +1.6% +10.0% ➖ noise
4 duckdb:vortex-compact -4.5% -4.2% -0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.9% -4.2% +3.5% +10.0% ➖ noise
5 datafusion:vortex-compact -6.1% -8.1% +2.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.3% -8.1% +7.3% +10.0% ➖ noise
5 duckdb:vortex-compact -2.2% -8.1% +6.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.0% -8.1% +7.7% +10.0% ➖ noise
6 datafusion:vortex-compact -3.3% -4.3% +1.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -6.1% -4.3% -1.9% +10.0% ➖ noise
6 duckdb:vortex-compact -1.2% -4.3% +3.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -10.8% -4.3% -6.7% +10.0% ➖ noise
7 datafusion:vortex-compact -4.9% -5.8% +1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.2% -5.8% -0.5% +10.0% ➖ noise
7 duckdb:vortex-compact -1.3% -5.8% +4.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.3% -5.8% +0.5% +22.0% ➖ noise
8 datafusion:vortex-compact -12.4% -10.6% -2.0% +20.0% ➖ noise
8 datafusion:vortex-file-compressed -8.2% -10.6% +2.7% +10.0% ➖ noise
8 duckdb:vortex-compact +0.4% -10.6% +12.2% +15.3% ➖ noise
8 duckdb:vortex-file-compressed -14.4% -10.6% -4.3% +25.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, -0.0% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB 32 B -0.0%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB 32 B -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (-0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.0%


datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50197610 49444189 1.02
tpch_q02/datafusion:vortex-file-compressed 23254676 22236954 1.05
tpch_q03/datafusion:vortex-file-compressed 29579144 27757412 1.07
tpch_q04/datafusion:vortex-file-compressed 21000531 21208314 0.99
tpch_q05/datafusion:vortex-file-compressed 48181689 49067606 0.98
tpch_q06/datafusion:vortex-file-compressed 10344932 10297137 1.00
tpch_q07/datafusion:vortex-file-compressed 55251968 54159291 1.02
tpch_q08/datafusion:vortex-file-compressed 39347722 39576183 0.99
tpch_q09/datafusion:vortex-file-compressed 53304459 51066340 1.04
tpch_q10/datafusion:vortex-file-compressed 38998433 40164728 0.97
tpch_q11/datafusion:vortex-file-compressed 15911562 15952576 1.00
tpch_q12/datafusion:vortex-file-compressed 24153764 24319414 0.99
tpch_q13/datafusion:vortex-file-compressed 24836943 24810320 1.00
tpch_q14/datafusion:vortex-file-compressed 16266819 16075410 1.01
tpch_q15/datafusion:vortex-file-compressed 24340026 24182438 1.01
tpch_q16/datafusion:vortex-file-compressed 19345656 18987256 1.02
tpch_q17/datafusion:vortex-file-compressed 66462842 67344920 0.99
tpch_q18/datafusion:vortex-file-compressed 80095714 79909727 1.00
tpch_q19/datafusion:vortex-file-compressed 19774830 20399577 0.97
tpch_q20/datafusion:vortex-file-compressed 28656412 29539971 0.97
tpch_q21/datafusion:vortex-file-compressed 71105245 70897145 1.00
tpch_q22/datafusion:vortex-file-compressed 12244168 12138682 1.01
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57293547 58789760 0.97
tpch_q02/datafusion:vortex-compact 25183410 25620948 0.98
tpch_q03/datafusion:vortex-compact 30327278 28531233 1.06
tpch_q04/datafusion:vortex-compact 23136875 22309519 1.04
tpch_q05/datafusion:vortex-compact 49603900 49178423 1.01
tpch_q06/datafusion:vortex-compact 12673091 12822150 0.99
tpch_q07/datafusion:vortex-compact 58875100 57813459 1.02
tpch_q08/datafusion:vortex-compact 42875930 42363596 1.01
tpch_q09/datafusion:vortex-compact 55632225 56125047 0.99
tpch_q10/datafusion:vortex-compact 44781832 45229854 0.99
tpch_q11/datafusion:vortex-compact 16531628 16933391 0.98
tpch_q12/datafusion:vortex-compact 29852254 30516658 0.98
tpch_q13/datafusion:vortex-compact 31198892 31378811 0.99
tpch_q14/datafusion:vortex-compact 18593458 18867946 0.99
tpch_q15/datafusion:vortex-compact 30175130 30427747 0.99
tpch_q16/datafusion:vortex-compact 24046725 23936742 1.00
tpch_q17/datafusion:vortex-compact 70450659 67993440 1.04
tpch_q18/datafusion:vortex-compact 81890132 82227139 1.00
tpch_q19/datafusion:vortex-compact 29815501 30298733 0.98
tpch_q20/datafusion:vortex-compact 33261165 33182303 1.00
tpch_q21/datafusion:vortex-compact 75791230 76361880 0.99
tpch_q22/datafusion:vortex-compact 12435163 12753143 0.98
datafusion / parquet (1.002x ➖, 1↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 132610187 129250904 1.03
tpch_q02/datafusion:parquet 59897896 60462634 0.99
tpch_q03/datafusion:parquet 72300030 71230406 1.02
tpch_q04/datafusion:parquet 43053332 43603939 0.99
tpch_q05/datafusion:parquet 91814492 91645347 1.00
tpch_q06/datafusion:parquet 🚨 41480534 35985375 1.15
tpch_q07/datafusion:parquet 104417063 102423108 1.02
tpch_q08/datafusion:parquet 89237081 96990612 0.92
tpch_q09/datafusion:parquet 127897183 121132894 1.06
tpch_q10/datafusion:parquet 109388375 110251936 0.99
tpch_q11/datafusion:parquet 39635487 40119956 0.99
tpch_q12/datafusion:parquet 80672036 82130620 0.98
tpch_q13/datafusion:parquet 195442168 196064926 1.00
tpch_q14/datafusion:parquet 45437523 46115804 0.99
tpch_q15/datafusion:parquet 58119498 57740698 1.01
tpch_q16/datafusion:parquet 38443324 39327280 0.98
tpch_q17/datafusion:parquet 126487312 126034525 1.00
tpch_q18/datafusion:parquet 159574673 159811878 1.00
tpch_q19/datafusion:parquet 🚀 73234725 81711262 0.90
tpch_q20/datafusion:parquet 67875150 64841838 1.05
tpch_q21/datafusion:parquet 133636025 134756582 0.99
tpch_q22/datafusion:parquet 31058026 30311768 1.02
datafusion / arrow (1.003x ➖, 0↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 54745787 57741999 0.95
tpch_q02/datafusion:arrow 18842983 19625420 0.96
tpch_q03/datafusion:arrow 29288647 29408313 1.00
tpch_q04/datafusion:arrow 26241568 25064603 1.05
tpch_q05/datafusion:arrow 🚨 83518119 73160841 1.14
tpch_q06/datafusion:arrow 20861038 19332051 1.08
tpch_q07/datafusion:arrow 99369514 100505025 0.99
tpch_q08/datafusion:arrow 44429484 41487721 1.07
tpch_q09/datafusion:arrow 62735944 66489525 0.94
tpch_q10/datafusion:arrow 45023084 48517219 0.93
tpch_q11/datafusion:arrow 9057577 8982367 1.01
tpch_q12/datafusion:arrow 50036781 50967457 0.98
tpch_q13/datafusion:arrow 46557763 46949617 0.99
tpch_q14/datafusion:arrow 21083254 21237320 0.99
tpch_q15/datafusion:arrow 43161239 41493685 1.04
tpch_q16/datafusion:arrow 19049614 18432116 1.03
tpch_q17/datafusion:arrow 66270709 67434863 0.98
tpch_q18/datafusion:arrow 131873534 132943375 0.99
tpch_q19/datafusion:arrow 34040120 34354239 0.99
tpch_q20/datafusion:arrow 33506574 33661803 1.00
tpch_q21/datafusion:arrow 148048733 148601853 1.00
tpch_q22/datafusion:arrow 17573827 17720917 0.99
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31828077 31703601 1.00
tpch_q02/duckdb:vortex-file-compressed 24313984 24872117 0.98
tpch_q03/duckdb:vortex-file-compressed 32847772 33569346 0.98
tpch_q04/duckdb:vortex-file-compressed 28797682 28592125 1.01
tpch_q05/duckdb:vortex-file-compressed 37669877 37668567 1.00
tpch_q06/duckdb:vortex-file-compressed 8078893 7755962 1.04
tpch_q07/duckdb:vortex-file-compressed 35076273 35143284 1.00
tpch_q08/duckdb:vortex-file-compressed 37286637 36548385 1.02
tpch_q09/duckdb:vortex-file-compressed 58038179 57202067 1.01
tpch_q10/duckdb:vortex-file-compressed 40902695 40923118 1.00
tpch_q11/duckdb:vortex-file-compressed 14946718 15048385 0.99
tpch_q12/duckdb:vortex-file-compressed 22752455 22341439 1.02
tpch_q13/duckdb:vortex-file-compressed 37927056 37746370 1.00
tpch_q14/duckdb:vortex-file-compressed 23303389 21806746 1.07
tpch_q15/duckdb:vortex-file-compressed 17107946 17388109 0.98
tpch_q16/duckdb:vortex-file-compressed 29723134 29887543 0.99
tpch_q17/duckdb:vortex-file-compressed 24472456 25051121 0.98
tpch_q18/duckdb:vortex-file-compressed 52493739 52935031 0.99
tpch_q19/duckdb:vortex-file-compressed 28560999 28477105 1.00
tpch_q20/duckdb:vortex-file-compressed 33105885 32947197 1.00
tpch_q21/duckdb:vortex-file-compressed 98512698 99981892 0.99
tpch_q22/duckdb:vortex-file-compressed 17780482 17001177 1.05
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38157522 38133847 1.00
tpch_q02/duckdb:vortex-compact 32150412 34378244 0.94
tpch_q03/duckdb:vortex-compact 34696141 34041785 1.02
tpch_q04/duckdb:vortex-compact 31110625 30922583 1.01
tpch_q05/duckdb:vortex-compact 40672944 40512062 1.00
tpch_q06/duckdb:vortex-compact 11312260 11141285 1.02
tpch_q07/duckdb:vortex-compact 40741684 41016844 0.99
tpch_q08/duckdb:vortex-compact 41867051 41805359 1.00
tpch_q09/duckdb:vortex-compact 64566801 65130594 0.99
tpch_q10/duckdb:vortex-compact 45041861 45088453 1.00
tpch_q11/duckdb:vortex-compact 17337201 17461566 0.99
tpch_q12/duckdb:vortex-compact 29873534 29722992 1.01
tpch_q13/duckdb:vortex-compact 44066190 44303299 0.99
tpch_q14/duckdb:vortex-compact 26313127 26317898 1.00
tpch_q15/duckdb:vortex-compact 19927400 19871514 1.00
tpch_q16/duckdb:vortex-compact 32640521 32674047 1.00
tpch_q17/duckdb:vortex-compact 29587346 29380844 1.01
tpch_q18/duckdb:vortex-compact 53512037 54161791 0.99
tpch_q19/duckdb:vortex-compact 33230465 32918111 1.01
tpch_q20/duckdb:vortex-compact 41687350 40069245 1.04
tpch_q21/duckdb:vortex-compact 103275474 101947256 1.01
tpch_q22/duckdb:vortex-compact 18786444 17982062 1.04
duckdb / parquet (1.013x ➖, 1↑ 4↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77134988 77331534 1.00
tpch_q02/duckdb:parquet 38920304 39544092 0.98
tpch_q03/duckdb:parquet 71081136 70647646 1.01
tpch_q04/duckdb:parquet 57154339 56497436 1.01
tpch_q05/duckdb:parquet 67761362 68970306 0.98
tpch_q06/duckdb:parquet 22363173 22233253 1.01
tpch_q07/duckdb:parquet 71347673 69462679 1.03
tpch_q08/duckdb:parquet 88051222 92818349 0.95
tpch_q09/duckdb:parquet 🚨 153867842 133485678 1.15
tpch_q10/duckdb:parquet 127171387 127852805 0.99
tpch_q11/duckdb:parquet 22089854 22376187 0.99
tpch_q12/duckdb:parquet 🚨 55114497 46936260 1.17
tpch_q13/duckdb:parquet 252292446 253048441 1.00
tpch_q14/duckdb:parquet 50321728 50841767 0.99
tpch_q15/duckdb:parquet 🚨 30389531 26030529 1.17
tpch_q16/duckdb:parquet 57771566 58110154 0.99
tpch_q17/duckdb:parquet 🚨 61674733 55508074 1.11
tpch_q18/duckdb:parquet 119106233 118783895 1.00
tpch_q19/duckdb:parquet 🚀 68333872 82107569 0.83
tpch_q20/duckdb:parquet 65729333 65166817 1.01
tpch_q21/duckdb:parquet 171626450 175215568 0.98
tpch_q22/duckdb:parquet 53239467 53769259 0.99
duckdb / duckdb (1.001x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17418739 17744507 0.98
tpch_q02/duckdb:duckdb 14986910 13972363 1.07
tpch_q03/duckdb:duckdb 22444449 22732517 0.99
tpch_q04/duckdb:duckdb 21336084 22325137 0.96
tpch_q05/duckdb:duckdb 22982998 23133758 0.99
tpch_q06/duckdb:duckdb 7071452 7035437 1.01
tpch_q07/duckdb:duckdb 25204568 25171474 1.00
tpch_q08/duckdb:duckdb 24004776 24048832 1.00
tpch_q09/duckdb:duckdb 57933819 58623684 0.99
tpch_q10/duckdb:duckdb 51074050 50444444 1.01
tpch_q11/duckdb:duckdb 7217738 7064215 1.02
tpch_q12/duckdb:duckdb 17851618 17743100 1.01
tpch_q13/duckdb:duckdb 38816443 39054532 0.99
tpch_q14/duckdb:duckdb 21352442 20801999 1.03
tpch_q15/duckdb:duckdb 13584162 13556255 1.00
tpch_q16/duckdb:duckdb 26013748 25897977 1.00
tpch_q17/duckdb:duckdb 16022340 16032290 1.00
tpch_q18/duckdb:duckdb 40806654 40945543 1.00
tpch_q19/duckdb:duckdb 31223405 30999862 1.01
tpch_q20/duckdb:duckdb 24953817 25089476 0.99
tpch_q21/duckdb:duckdb 60569131 61443853 0.99
tpch_q22/duckdb:duckdb 25201254 25411959 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -5.2% +1.2% -6.3% +16.6% ➖ noise
1 datafusion:vortex-compact -2.5% +1.2% -3.7% +16.1% ➖ noise
1 datafusion:vortex-file-compressed +1.5% +1.2% +0.4% +17.9% ➖ noise
1 duckdb:duckdb -1.8% +1.2% -3.0% +14.4% ➖ noise
1 duckdb:vortex-compact +0.1% +1.2% -1.1% +14.4% ➖ noise
1 duckdb:vortex-file-compressed +0.4% +1.2% -0.8% +18.7% ➖ noise
2 datafusion:arrow -4.0% -1.3% -2.8% +14.4% ➖ noise
2 datafusion:vortex-compact -1.7% -1.3% -0.5% +14.4% ➖ noise
2 datafusion:vortex-file-compressed +4.6% -1.3% +5.9% +14.4% ➖ noise
2 duckdb:duckdb +7.3% -1.3% +8.6% +14.4% ➖ noise
2 duckdb:vortex-compact -6.5% -1.3% -5.3% +14.4% ➖ noise
2 duckdb:vortex-file-compressed -2.2% -1.3% -1.0% +14.4% ➖ noise
3 datafusion:arrow -0.4% +1.1% -1.4% +14.4% ➖ noise
3 datafusion:vortex-compact +6.3% +1.1% +5.2% +14.4% ➖ noise
3 datafusion:vortex-file-compressed +6.6% +1.1% +5.4% +14.4% ➖ noise
3 duckdb:duckdb -1.3% +1.1% -2.3% +14.4% ➖ noise
3 duckdb:vortex-compact +1.9% +1.1% +0.9% +14.4% ➖ noise
3 duckdb:vortex-file-compressed -2.1% +1.1% -3.2% +14.4% ➖ noise
4 datafusion:arrow +4.7% -0.1% +4.8% +14.4% ➖ noise
4 datafusion:vortex-compact +3.7% -0.1% +3.8% +14.4% ➖ noise
4 datafusion:vortex-file-compressed -1.0% -0.1% -0.9% +14.4% ➖ noise
4 duckdb:duckdb -4.4% -0.1% -4.4% +14.4% ➖ noise
4 duckdb:vortex-compact +0.6% -0.1% +0.7% +14.4% ➖ noise
4 duckdb:vortex-file-compressed +0.7% -0.1% +0.8% +14.4% ➖ noise
5 datafusion:arrow +14.2% -0.8% +15.1% +14.4% 🚨 regression
5 datafusion:vortex-compact +0.9% -0.8% +1.7% +14.4% ➖ noise
5 datafusion:vortex-file-compressed -1.8% -0.8% -1.0% +14.4% ➖ noise
5 duckdb:duckdb -0.7% -0.8% +0.1% +14.4% ➖ noise
5 duckdb:vortex-compact +0.4% -0.8% +1.2% +14.4% ➖ noise
5 duckdb:vortex-file-compressed +0.0% -0.8% +0.8% +14.4% ➖ noise
6 datafusion:arrow +7.9% +7.7% +0.2% +14.9% ➖ noise
6 datafusion:vortex-compact -1.2% +7.7% -8.2% +16.6% ➖ noise
6 datafusion:vortex-file-compressed +0.5% +7.7% -6.7% +15.7% ➖ noise
6 duckdb:duckdb +0.5% +7.7% -6.7% +15.4% ➖ noise
6 duckdb:vortex-compact +1.5% +7.7% -5.7% +24.0% ➖ noise
6 duckdb:vortex-file-compressed +4.2% +7.7% -3.3% +19.9% ➖ noise
7 datafusion:arrow -1.1% +2.3% -3.4% +14.4% ➖ noise
7 datafusion:vortex-compact +1.8% +2.3% -0.5% +14.4% ➖ noise
7 datafusion:vortex-file-compressed +2.0% +2.3% -0.3% +14.4% ➖ noise
7 duckdb:duckdb +0.1% +2.3% -2.1% +14.4% ➖ noise
7 duckdb:vortex-compact -0.7% +2.3% -2.9% +14.4% ➖ noise
7 duckdb:vortex-file-compressed -0.2% +2.3% -2.5% +14.4% ➖ noise
8 datafusion:arrow +7.1% -6.6% +14.6% +14.4% 🚨 regression
8 datafusion:vortex-compact +1.2% -6.6% +8.3% +14.4% ➖ noise
8 datafusion:vortex-file-compressed -0.6% -6.6% +6.4% +14.4% ➖ noise
8 duckdb:duckdb -0.2% -6.6% +6.8% +14.4% ➖ noise
8 duckdb:vortex-compact +0.1% -6.6% +7.2% +14.4% ➖ noise
8 duckdb:vortex-file-compressed +2.0% -6.6% +9.2% +14.4% ➖ noise
9 datafusion:arrow -5.6% +10.3% -14.5% +14.4% ✅ faster
9 datafusion:vortex-compact -0.9% +10.3% -10.2% +14.4% ➖ noise
9 datafusion:vortex-file-compressed +4.4% +10.3% -5.4% +14.4% ➖ noise
9 duckdb:duckdb -1.2% +10.3% -10.4% +14.4% ➖ noise
9 duckdb:vortex-compact -0.9% +10.3% -10.1% +14.4% ➖ noise
9 duckdb:vortex-file-compressed +1.5% +10.3% -8.0% +14.4% ➖ noise
10 datafusion:arrow -7.2% -0.7% -6.6% +14.4% ➖ noise
10 datafusion:vortex-compact -1.0% -0.7% -0.3% +14.4% ➖ noise
10 datafusion:vortex-file-compressed -2.9% -0.7% -2.3% +14.4% ➖ noise
10 duckdb:duckdb +1.2% -0.7% +1.9% +14.4% ➖ noise
10 duckdb:vortex-compact -0.1% -0.7% +0.6% +14.4% ➖ noise
10 duckdb:vortex-file-compressed -0.0% -0.7% +0.6% +14.4% ➖ noise
11 datafusion:arrow +0.8% -1.2% +2.1% +14.4% ➖ noise
11 datafusion:vortex-compact -2.4% -1.2% -1.1% +14.4% ➖ noise
11 datafusion:vortex-file-compressed -0.3% -1.2% +1.0% +14.4% ➖ noise
11 duckdb:duckdb +2.2% -1.2% +3.5% +14.4% ➖ noise
11 duckdb:vortex-compact -0.7% -1.2% +0.5% +14.4% ➖ noise
11 duckdb:vortex-file-compressed -0.7% -1.2% +0.6% +14.4% ➖ noise
12 datafusion:arrow -1.8% +7.4% -8.6% +18.8% ➖ noise
12 datafusion:vortex-compact -2.2% +7.4% -8.9% +14.4% ➖ noise
12 datafusion:vortex-file-compressed -0.7% +7.4% -7.5% +14.4% ➖ noise
12 duckdb:duckdb +0.6% +7.4% -6.3% +14.4% ➖ noise
12 duckdb:vortex-compact +0.5% +7.4% -6.4% +14.4% ➖ noise
12 duckdb:vortex-file-compressed +1.8% +7.4% -5.2% +14.4% ➖ noise
13 datafusion:arrow -0.8% -0.3% -0.5% +14.4% ➖ noise
13 datafusion:vortex-compact -0.6% -0.3% -0.3% +14.4% ➖ noise
13 datafusion:vortex-file-compressed +0.1% -0.3% +0.4% +14.4% ➖ noise
13 duckdb:duckdb -0.6% -0.3% -0.3% +14.4% ➖ noise
13 duckdb:vortex-compact -0.5% -0.3% -0.2% +14.4% ➖ noise
13 duckdb:vortex-file-compressed +0.5% -0.3% +0.8% +14.4% ➖ noise
14 datafusion:arrow -0.7% -1.2% +0.5% +14.4% ➖ noise
14 datafusion:vortex-compact -1.5% -1.2% -0.2% +14.4% ➖ noise
14 datafusion:vortex-file-compressed +1.2% -1.2% +2.5% +14.4% ➖ noise
14 duckdb:duckdb +2.6% -1.2% +3.9% +14.4% ➖ noise
14 duckdb:vortex-compact -0.0% -1.2% +1.2% +14.4% ➖ noise
14 duckdb:vortex-file-compressed +6.9% -1.2% +8.2% +14.4% ➖ noise
15 datafusion:arrow +4.0% +8.4% -4.0% +14.4% ➖ noise
15 datafusion:vortex-compact -0.8% +8.4% -8.5% +14.4% ➖ noise
15 datafusion:vortex-file-compressed +0.7% +8.4% -7.2% +14.4% ➖ noise
15 duckdb:duckdb +0.2% +8.4% -7.6% +14.4% ➖ noise
15 duckdb:vortex-compact +0.3% +8.4% -7.5% +14.4% ➖ noise
15 duckdb:vortex-file-compressed -1.6% +8.4% -9.2% +15.2% ➖ noise
16 datafusion:arrow +3.4% -1.4% +4.8% +14.4% ➖ noise
16 datafusion:vortex-compact +0.5% -1.4% +1.9% +14.4% ➖ noise
16 datafusion:vortex-file-compressed +1.9% -1.4% +3.4% +14.4% ➖ noise
16 duckdb:duckdb +0.4% -1.4% +1.9% +14.4% ➖ noise
16 duckdb:vortex-compact -0.1% -1.4% +1.3% +14.4% ➖ noise
16 duckdb:vortex-file-compressed -0.6% -1.4% +0.9% +14.4% ➖ noise
17 datafusion:arrow -1.7% +5.6% -6.9% +14.4% ➖ noise
17 datafusion:vortex-compact +3.6% +5.6% -1.9% +14.4% ➖ noise
17 datafusion:vortex-file-compressed -1.3% +5.6% -6.5% +14.4% ➖ noise
17 duckdb:duckdb -0.1% +5.6% -5.4% +14.4% ➖ noise
17 duckdb:vortex-compact +0.7% +5.6% -4.6% +14.4% ➖ noise
17 duckdb:vortex-file-compressed -2.3% +5.6% -7.5% +14.4% ➖ noise
18 datafusion:arrow -0.8% +0.1% -0.9% +14.4% ➖ noise
18 datafusion:vortex-compact -0.4% +0.1% -0.5% +14.4% ➖ noise
18 datafusion:vortex-file-compressed +0.2% +0.1% +0.2% +14.4% ➖ noise
18 duckdb:duckdb -0.3% +0.1% -0.4% +14.4% ➖ noise
18 duckdb:vortex-compact -1.2% +0.1% -1.3% +14.4% ➖ noise
18 duckdb:vortex-file-compressed -0.8% +0.1% -0.9% +14.4% ➖ noise
19 datafusion:arrow -0.9% -13.6% +14.7% +14.4% 🚨 regression
19 datafusion:vortex-compact -1.6% -13.6% +13.9% +14.4% ➖ noise
19 datafusion:vortex-file-compressed -3.1% -13.6% +12.2% +14.4% ➖ noise
19 duckdb:duckdb +0.7% -13.6% +16.6% +14.4% 🚨 regression
19 duckdb:vortex-compact +0.9% -13.6% +16.9% +14.4% 🚨 regression
19 duckdb:vortex-file-compressed +0.3% -13.6% +16.1% +14.4% 🚨 regression
20 datafusion:arrow -0.5% +2.8% -3.1% +14.4% ➖ noise
20 datafusion:vortex-compact +0.2% +2.8% -2.4% +14.4% ➖ noise
20 datafusion:vortex-file-compressed -3.0% +2.8% -5.6% +14.4% ➖ noise
20 duckdb:duckdb -0.5% +2.8% -3.2% +14.4% ➖ noise
20 duckdb:vortex-compact +4.0% +2.8% +1.3% +14.4% ➖ noise
20 duckdb:vortex-file-compressed +0.5% +2.8% -2.2% +14.4% ➖ noise
21 datafusion:arrow -0.4% -1.4% +1.1% +14.4% ➖ noise
21 datafusion:vortex-compact -0.7% -1.4% +0.7% +14.4% ➖ noise
21 datafusion:vortex-file-compressed +0.3% -1.4% +1.8% +14.4% ➖ noise
21 duckdb:duckdb -1.4% -1.4% +0.0% +14.4% ➖ noise
21 duckdb:vortex-compact +1.3% -1.4% +2.8% +14.4% ➖ noise
21 duckdb:vortex-file-compressed -1.5% -1.4% -0.0% +14.4% ➖ noise
22 datafusion:arrow -0.8% +0.7% -1.5% +14.4% ➖ noise
22 datafusion:vortex-compact -2.5% +0.7% -3.2% +14.4% ➖ noise
22 datafusion:vortex-file-compressed +0.9% +0.7% +0.1% +14.4% ➖ noise
22 duckdb:duckdb -0.8% +0.7% -1.5% +14.4% ➖ noise
22 duckdb:vortex-compact +4.5% +0.7% +3.7% +14.4% ➖ noise
22 duckdb:vortex-file-compressed +4.6% +0.7% +3.8% +14.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

File Size Changes (18 files changed, -0.0% overall, 0↑ 18↓)
File Scale Format Base HEAD Change %
lineitem_0.vortex 1.0 vortex-file-compressed 85.42 MB 85.42 MB 32 B -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.90 MB 84.90 MB 32 B -0.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 63.03 MB 32 B -0.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 63.00 MB 32 B -0.0%
orders_0.vortex 1.0 vortex-file-compressed 43.43 MB 43.43 MB 32 B -0.0%
partsupp_0.vortex 1.0 vortex-file-compressed 35.94 MB 35.94 MB 32 B -0.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 31.73 MB 32 B -0.0%
partsupp_0.vortex 1.0 vortex-compact 25.23 MB 25.23 MB 32 B -0.0%
customer_0.vortex 1.0 vortex-file-compressed 10.50 MB 10.50 MB 32 B -0.0%
customer_0.vortex 1.0 vortex-compact 7.43 MB 7.43 MB 32 B -0.0%
part_0.vortex 1.0 vortex-file-compressed 5.44 MB 5.44 MB 32 B -0.0%
part_0.vortex 1.0 vortex-compact 3.64 MB 3.64 MB 32 B -0.0%
supplier_0.vortex 1.0 vortex-file-compressed 706.34 KB 706.31 KB 32 B -0.0%
supplier_0.vortex 1.0 vortex-compact 496.72 KB 496.69 KB 32 B -0.0%
nation_0.vortex 1.0 vortex-file-compressed 11.00 KB 10.97 KB 32 B -0.3%
nation_0.vortex 1.0 vortex-compact 8.34 KB 8.31 KB 32 B -0.4%
region_0.vortex 1.0 vortex-file-compressed 6.16 KB 6.13 KB 32 B -0.5%
region_0.vortex 1.0 vortex-compact 5.86 KB 5.82 KB 32 B -0.5%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (-0.0%)
  • vortex-file-compressed: 266.61 MB → 266.60 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.3%


datafusion / vortex-file-compressed (0.989x ➖, 2↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24657536 24436446 1.01
tpcds_q02/datafusion:vortex-file-compressed 45743589 46078967 0.99
tpcds_q03/datafusion:vortex-file-compressed 14647744 14993527 0.98
tpcds_q04/datafusion:vortex-file-compressed 258058696 256460525 1.01
tpcds_q05/datafusion:vortex-file-compressed 44146112 44041383 1.00
tpcds_q06/datafusion:vortex-file-compressed 58818022 62084377 0.95
tpcds_q07/datafusion:vortex-file-compressed 40408070 40701454 0.99
tpcds_q08/datafusion:vortex-file-compressed 28438428 28589079 0.99
tpcds_q09/datafusion:vortex-file-compressed 38135918 39309489 0.97
tpcds_q10/datafusion:vortex-file-compressed 38086467 37222035 1.02
tpcds_q11/datafusion:vortex-file-compressed 124335337 130613081 0.95
tpcds_q12/datafusion:vortex-file-compressed 18926395 19576697 0.97
tpcds_q13/datafusion:vortex-file-compressed 38262102 39703113 0.96
tpcds_q14/datafusion:vortex-file-compressed 169951570 167377237 1.02
tpcds_q15/datafusion:vortex-file-compressed 29822577 28127595 1.06
tpcds_q16/datafusion:vortex-file-compressed 28448168 27735484 1.03
tpcds_q17/datafusion:vortex-file-compressed 62494251 61172640 1.02
tpcds_q18/datafusion:vortex-file-compressed 67872252 68989162 0.98
tpcds_q19/datafusion:vortex-file-compressed 22027734 22883431 0.96
tpcds_q20/datafusion:vortex-file-compressed 21832100 20955117 1.04
tpcds_q21/datafusion:vortex-file-compressed 35209321 34992936 1.01
tpcds_q22/datafusion:vortex-file-compressed 109962976 113453173 0.97
tpcds_q23/datafusion:vortex-file-compressed 148184840 146090943 1.01
tpcds_q24/datafusion:vortex-file-compressed 84205240 81611907 1.03
tpcds_q25/datafusion:vortex-file-compressed 64511063 64195107 1.00
tpcds_q26/datafusion:vortex-file-compressed 34060274 33198007 1.03
tpcds_q27/datafusion:vortex-file-compressed 102272973 104903242 0.97
tpcds_q28/datafusion:vortex-file-compressed 33586179 35788400 0.94
tpcds_q29/datafusion:vortex-file-compressed 60523894 61328905 0.99
tpcds_q30/datafusion:vortex-file-compressed 22193102 23514111 0.94
tpcds_q31/datafusion:vortex-file-compressed 73712771 73260927 1.01
tpcds_q32/datafusion:vortex-file-compressed 19666709 20174654 0.97
tpcds_q33/datafusion:vortex-file-compressed 29167702 28870241 1.01
tpcds_q34/datafusion:vortex-file-compressed 23692249 23942293 0.99
tpcds_q35/datafusion:vortex-file-compressed 44218776 45085821 0.98
tpcds_q36/datafusion:vortex-file-compressed 57515340 57383510 1.00
tpcds_q37/datafusion:vortex-file-compressed 23279869 23969900 0.97
tpcds_q38/datafusion:vortex-file-compressed 41621063 42856217 0.97
tpcds_q39/datafusion:vortex-file-compressed 105256993 103198968 1.02
tpcds_q40/datafusion:vortex-file-compressed 32649835 31945215 1.02
tpcds_q41/datafusion:vortex-file-compressed 15240394 14514124 1.05
tpcds_q42/datafusion:vortex-file-compressed 13918970 13757653 1.01
tpcds_q43/datafusion:vortex-file-compressed 18571815 18439418 1.01
tpcds_q44/datafusion:vortex-file-compressed 30760352 31475667 0.98
tpcds_q45/datafusion:vortex-file-compressed 27224425 27129759 1.00
tpcds_q46/datafusion:vortex-file-compressed 33540640 35204912 0.95
tpcds_q47/datafusion:vortex-file-compressed 129998838 128749631 1.01
tpcds_q48/datafusion:vortex-file-compressed 36139419 35953984 1.01
tpcds_q49/datafusion:vortex-file-compressed 57037338 58190409 0.98
tpcds_q50/datafusion:vortex-file-compressed 39607824 37867076 1.05
tpcds_q51/datafusion:vortex-file-compressed 85975539 85028785 1.01
tpcds_q52/datafusion:vortex-file-compressed 14056308 14740062 0.95
tpcds_q53/datafusion:vortex-file-compressed 20904617 21384492 0.98
tpcds_q54/datafusion:vortex-file-compressed 33988097 34596116 0.98
tpcds_q55/datafusion:vortex-file-compressed 14592724 13770174 1.06
tpcds_q56/datafusion:vortex-file-compressed 29940498 29611282 1.01
tpcds_q57/datafusion:vortex-file-compressed 105025721 109796909 0.96
tpcds_q58/datafusion:vortex-file-compressed 50859709 53634171 0.95
tpcds_q59/datafusion:vortex-file-compressed 55869577 55823109 1.00
tpcds_q60/datafusion:vortex-file-compressed 28786987 29237360 0.98
tpcds_q61/datafusion:vortex-file-compressed 40299425 39766882 1.01
tpcds_q62/datafusion:vortex-file-compressed 🚀 23048367 26177290 0.88
tpcds_q63/datafusion:vortex-file-compressed 21438093 21439220 1.00
tpcds_q64/datafusion:vortex-file-compressed 398826162 407734138 0.98
tpcds_q65/datafusion:vortex-file-compressed 41364138 39258481 1.05
tpcds_q66/datafusion:vortex-file-compressed 72161612 71224283 1.01
tpcds_q67/datafusion:vortex-file-compressed 143679228 152601509 0.94
tpcds_q68/datafusion:vortex-file-compressed 31780448 31476349 1.01
tpcds_q69/datafusion:vortex-file-compressed 35003366 34909320 1.00
tpcds_q70/datafusion:vortex-file-compressed 86244772 89519081 0.96
tpcds_q71/datafusion:vortex-file-compressed 22230915 23073400 0.96
tpcds_q72/datafusion:vortex-file-compressed 2126409879 2151691299 0.99
tpcds_q73/datafusion:vortex-file-compressed 22760086 23012179 0.99
tpcds_q74/datafusion:vortex-file-compressed 75766731 81050887 0.93
tpcds_q75/datafusion:vortex-file-compressed 105060269 107848061 0.97
tpcds_q76/datafusion:vortex-file-compressed 23828215 23397529 1.02
tpcds_q77/datafusion:vortex-file-compressed 41309567 40362633 1.02
tpcds_q78/datafusion:vortex-file-compressed 121272772 126114385 0.96
tpcds_q79/datafusion:vortex-file-compressed 27281895 27362800 1.00
tpcds_q80/datafusion:vortex-file-compressed 90937252 94458690 0.96
tpcds_q81/datafusion:vortex-file-compressed 23297759 25885749 0.90
tpcds_q82/datafusion:vortex-file-compressed 25484627 25531667 1.00
tpcds_q83/datafusion:vortex-file-compressed 32859824 33522693 0.98
tpcds_q84/datafusion:vortex-file-compressed 11961944 12444625 0.96
tpcds_q85/datafusion:vortex-file-compressed 89152058 89761198 0.99
tpcds_q86/datafusion:vortex-file-compressed 🚀 15144820 17624396 0.86
tpcds_q87/datafusion:vortex-file-compressed 43189500 42757595 1.01
tpcds_q88/datafusion:vortex-file-compressed 55962907 55698195 1.00
tpcds_q89/datafusion:vortex-file-compressed 24187473 24509301 0.99
tpcds_q90/datafusion:vortex-file-compressed 14163242 14318175 0.99
tpcds_q91/datafusion:vortex-file-compressed 17825206 17915941 0.99
tpcds_q92/datafusion:vortex-file-compressed 17090762 18134990 0.94
tpcds_q93/datafusion:vortex-file-compressed 33115043 33396883 0.99
tpcds_q94/datafusion:vortex-file-compressed 23136448 22686471 1.02
tpcds_q95/datafusion:vortex-file-compressed 60415612 61903181 0.98
tpcds_q96/datafusion:vortex-file-compressed 14334386 13506446 1.06
tpcds_q97/datafusion:vortex-file-compressed 31622347 31212504 1.01
tpcds_q98/datafusion:vortex-file-compressed 23219892 23516428 0.99
tpcds_q99/datafusion:vortex-file-compressed 31654811 32326785 0.98
datafusion / vortex-compact (0.992x ➖, 2↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 24765419 25223990 0.98
tpcds_q02/datafusion:vortex-compact 52503687 53864749 0.97
tpcds_q03/datafusion:vortex-compact 19161860 19290741 0.99
tpcds_q04/datafusion:vortex-compact 285514985 290372401 0.98
tpcds_q05/datafusion:vortex-compact 47003073 47702444 0.99
tpcds_q06/datafusion:vortex-compact 60144257 61197067 0.98
tpcds_q07/datafusion:vortex-compact 52784731 55238899 0.96
tpcds_q08/datafusion:vortex-compact 35486231 36120009 0.98
tpcds_q09/datafusion:vortex-compact 52918758 52696370 1.00
tpcds_q10/datafusion:vortex-compact 48937251 47498884 1.03
tpcds_q11/datafusion:vortex-compact 145272513 153026470 0.95
tpcds_q12/datafusion:vortex-compact 25882136 25931024 1.00
tpcds_q13/datafusion:vortex-compact 🚨 145018554 121733294 1.19
tpcds_q14/datafusion:vortex-compact 198477413 195683942 1.01
tpcds_q15/datafusion:vortex-compact 30740977 30316035 1.01
tpcds_q16/datafusion:vortex-compact 32095573 33392951 0.96
tpcds_q17/datafusion:vortex-compact 73039160 73037792 1.00
tpcds_q18/datafusion:vortex-compact 77822148 77352435 1.01
tpcds_q19/datafusion:vortex-compact 🚀 29378279 32778038 0.90
tpcds_q20/datafusion:vortex-compact 25334569 25723184 0.98
tpcds_q21/datafusion:vortex-compact 40662627 39420260 1.03
tpcds_q22/datafusion:vortex-compact 128071986 129016807 0.99
tpcds_q23/datafusion:vortex-compact 161726747 163368878 0.99
tpcds_q24/datafusion:vortex-compact 95762856 95362702 1.00
tpcds_q25/datafusion:vortex-compact 77027119 80299677 0.96
tpcds_q26/datafusion:vortex-compact 43136370 44167486 0.98
tpcds_q27/datafusion:vortex-compact 124295038 122786052 1.01
tpcds_q28/datafusion:vortex-compact 96814091 101815441 0.95
tpcds_q29/datafusion:vortex-compact 74755856 72081977 1.04
tpcds_q30/datafusion:vortex-compact 26642699 26939512 0.99
tpcds_q31/datafusion:vortex-compact 95871091 97357108 0.98
tpcds_q32/datafusion:vortex-compact 24670431 24562107 1.00
tpcds_q33/datafusion:vortex-compact 36112212 36358428 0.99
tpcds_q34/datafusion:vortex-compact 32752047 32725691 1.00
tpcds_q35/datafusion:vortex-compact 50791173 50293515 1.01
tpcds_q36/datafusion:vortex-compact 78724624 75038359 1.05
tpcds_q37/datafusion:vortex-compact 33121080 34136327 0.97
tpcds_q38/datafusion:vortex-compact 48865020 51202696 0.95
tpcds_q39/datafusion:vortex-compact 111493928 108979461 1.02
tpcds_q40/datafusion:vortex-compact 35905278 35902211 1.00
tpcds_q41/datafusion:vortex-compact 16972373 16639440 1.02
tpcds_q42/datafusion:vortex-compact 18481703 18273347 1.01
tpcds_q43/datafusion:vortex-compact 24023316 24393148 0.98
tpcds_q44/datafusion:vortex-compact 48787900 48888620 1.00
tpcds_q45/datafusion:vortex-compact 31024681 31217866 0.99
tpcds_q46/datafusion:vortex-compact 46893684 43386881 1.08
tpcds_q47/datafusion:vortex-compact 147710659 149993034 0.98
tpcds_q48/datafusion:vortex-compact 81632572 80120940 1.02
tpcds_q49/datafusion:vortex-compact 69669334 69793083 1.00
tpcds_q50/datafusion:vortex-compact 46875079 47166939 0.99
tpcds_q51/datafusion:vortex-compact 92890517 95225555 0.98
tpcds_q52/datafusion:vortex-compact 18818003 18300528 1.03
tpcds_q53/datafusion:vortex-compact 29026478 27719083 1.05
tpcds_q54/datafusion:vortex-compact 42007894 41545388 1.01
tpcds_q55/datafusion:vortex-compact 18488216 18227144 1.01
tpcds_q56/datafusion:vortex-compact 36105541 37058961 0.97
tpcds_q57/datafusion:vortex-compact 114654043 122207592 0.94
tpcds_q58/datafusion:vortex-compact 59918679 63613453 0.94
tpcds_q59/datafusion:vortex-compact 67783830 69302791 0.98
tpcds_q60/datafusion:vortex-compact 35341224 37191848 0.95
tpcds_q61/datafusion:vortex-compact 54442207 55055125 0.99
tpcds_q62/datafusion:vortex-compact 24313870 23868171 1.02
tpcds_q63/datafusion:vortex-compact 28363805 27601788 1.03
tpcds_q64/datafusion:vortex-compact 447243006 459759673 0.97
tpcds_q65/datafusion:vortex-compact 53563333 52453118 1.02
tpcds_q66/datafusion:vortex-compact 78106254 74398100 1.05
tpcds_q67/datafusion:vortex-compact 151900253 152252610 1.00
tpcds_q68/datafusion:vortex-compact 44189012 43779641 1.01
tpcds_q69/datafusion:vortex-compact 45255050 45524265 0.99
tpcds_q70/datafusion:vortex-compact 97207188 96834431 1.00
tpcds_q71/datafusion:vortex-compact 31267562 30056982 1.04
tpcds_q72/datafusion:vortex-compact 2103695666 2106260703 1.00
tpcds_q73/datafusion:vortex-compact 29814585 29982371 0.99
tpcds_q74/datafusion:vortex-compact 96960484 90367170 1.07
tpcds_q75/datafusion:vortex-compact 128547867 129068773 1.00
tpcds_q76/datafusion:vortex-compact 31905960 32305316 0.99
tpcds_q77/datafusion:vortex-compact 50583376 50576639 1.00
tpcds_q78/datafusion:vortex-compact 141198636 142828242 0.99
tpcds_q79/datafusion:vortex-compact 37576843 37478006 1.00
tpcds_q80/datafusion:vortex-compact 101261419 103586516 0.98
tpcds_q81/datafusion:vortex-compact 28197464 27871336 1.01
tpcds_q82/datafusion:vortex-compact 33962806 34600803 0.98
tpcds_q83/datafusion:vortex-compact 32582737 33880785 0.96
tpcds_q84/datafusion:vortex-compact 13458779 14410048 0.93
tpcds_q85/datafusion:vortex-compact 151831173 159865885 0.95
tpcds_q86/datafusion:vortex-compact 🚀 17549948 20388424 0.86
tpcds_q87/datafusion:vortex-compact 51853082 51454089 1.01
tpcds_q88/datafusion:vortex-compact 75508276 82037883 0.92
tpcds_q89/datafusion:vortex-compact 30724977 31415818 0.98
tpcds_q90/datafusion:vortex-compact 15303317 15014481 1.02
tpcds_q91/datafusion:vortex-compact 33223344 33222674 1.00
tpcds_q92/datafusion:vortex-compact 23134237 24887592 0.93
tpcds_q93/datafusion:vortex-compact 37283984 38820734 0.96
tpcds_q94/datafusion:vortex-compact 25009035 26357877 0.95
tpcds_q95/datafusion:vortex-compact 65299409 67580209 0.97
tpcds_q96/datafusion:vortex-compact 17387647 17378578 1.00
tpcds_q97/datafusion:vortex-compact 35974429 35834588 1.00
tpcds_q98/datafusion:vortex-compact 29108079 29975450 0.97
tpcds_q99/datafusion:vortex-compact 30335556 29990734 1.01
datafusion / parquet (1.008x ➖, 0↑ 3↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29126203 31666124 0.92
tpcds_q02/datafusion:parquet 40554702 41377642 0.98
tpcds_q03/datafusion:parquet 12932216 13855817 0.93
tpcds_q04/datafusion:parquet 262782772 265394351 0.99
tpcds_q05/datafusion:parquet 40224331 40817076 0.99
tpcds_q06/datafusion:parquet 59200099 59114034 1.00
tpcds_q07/datafusion:parquet 77981124 75890747 1.03
tpcds_q08/datafusion:parquet 26869775 25370647 1.06
tpcds_q09/datafusion:parquet 46028323 43813916 1.05
tpcds_q10/datafusion:parquet 69153519 66876382 1.03
tpcds_q11/datafusion:parquet 147118437 146003295 1.01
tpcds_q12/datafusion:parquet 17270448 15776301 1.09
tpcds_q13/datafusion:parquet 74306846 74122955 1.00
tpcds_q14/datafusion:parquet 158245847 159221481 0.99
tpcds_q15/datafusion:parquet 20308039 20573253 0.99
tpcds_q16/datafusion:parquet 22982522 22875533 1.00
tpcds_q17/datafusion:parquet 61197357 64100210 0.95
tpcds_q18/datafusion:parquet 111258245 112794822 0.99
tpcds_q19/datafusion:parquet 22198972 21894900 1.01
tpcds_q20/datafusion:parquet 🚨 17296646 15657863 1.10
tpcds_q21/datafusion:parquet 18559275 18071496 1.03
tpcds_q22/datafusion:parquet 155762243 147866770 1.05
tpcds_q23/datafusion:parquet 144199698 142153495 1.01
tpcds_q24/datafusion:parquet 89060064 90362450 0.99
tpcds_q25/datafusion:parquet 64668766 62393133 1.04
tpcds_q26/datafusion:parquet 64361332 63379531 1.02
tpcds_q27/datafusion:parquet 144444108 142257599 1.02
tpcds_q28/datafusion:parquet 42901345 44700030 0.96
tpcds_q29/datafusion:parquet 66273737 64127757 1.03
tpcds_q30/datafusion:parquet 33826002 33888764 1.00
tpcds_q31/datafusion:parquet 63025990 62708203 1.01
tpcds_q32/datafusion:parquet 17951769 17794929 1.01
tpcds_q33/datafusion:parquet 26058916 26642954 0.98
tpcds_q34/datafusion:parquet 20217199 20558913 0.98
tpcds_q35/datafusion:parquet 68274024 68982405 0.99
tpcds_q36/datafusion:parquet 56910534 56365773 1.01
tpcds_q37/datafusion:parquet 18485941 18434178 1.00
tpcds_q38/datafusion:parquet 39283166 39104044 1.00
tpcds_q39/datafusion:parquet 72261915 72674484 0.99
tpcds_q40/datafusion:parquet 24381530 23828878 1.02
tpcds_q41/datafusion:parquet 12959004 13126828 0.99
tpcds_q42/datafusion:parquet 11817751 11250706 1.05
tpcds_q43/datafusion:parquet 16547629 18037029 0.92
tpcds_q44/datafusion:parquet 30909823 31426643 0.98
tpcds_q45/datafusion:parquet 27208055 26970633 1.01
tpcds_q46/datafusion:parquet 31178836 30952428 1.01
tpcds_q47/datafusion:parquet 123720724 121216389 1.02
tpcds_q48/datafusion:parquet 68740593 66826658 1.03
tpcds_q49/datafusion:parquet 54145321 53078809 1.02
tpcds_q50/datafusion:parquet 43087739 42830784 1.01
tpcds_q51/datafusion:parquet 84734897 83705532 1.01
tpcds_q52/datafusion:parquet 11988496 11588155 1.03
tpcds_q53/datafusion:parquet 17431504 17694067 0.99
tpcds_q54/datafusion:parquet 32759679 32588150 1.01
tpcds_q55/datafusion:parquet 10730957 10732823 1.00
tpcds_q56/datafusion:parquet 27220525 26919806 1.01
tpcds_q57/datafusion:parquet 101421447 97246636 1.04
tpcds_q58/datafusion:parquet 50191843 49673494 1.01
tpcds_q59/datafusion:parquet 55968213 55258416 1.01
tpcds_q60/datafusion:parquet 26126786 26725459 0.98
tpcds_q61/datafusion:parquet 41911930 42647483 0.98
tpcds_q62/datafusion:parquet 24339648 23999133 1.01
tpcds_q63/datafusion:parquet 17730815 17347556 1.02
tpcds_q64/datafusion:parquet 496532117 503900163 0.99
tpcds_q65/datafusion:parquet 36737331 36998025 0.99
tpcds_q66/datafusion:parquet 🚨 72616974 65005783 1.12
tpcds_q67/datafusion:parquet 141312169 141540295 1.00
tpcds_q68/datafusion:parquet 31238949 31965550 0.98
tpcds_q69/datafusion:parquet 62821949 63086510 1.00
tpcds_q70/datafusion:parquet 84713284 86286633 0.98
tpcds_q71/datafusion:parquet 22850007 21789448 1.05
tpcds_q72/datafusion:parquet 593963159 585145810 1.02
tpcds_q73/datafusion:parquet 🚨 22664295 19978154 1.13
tpcds_q74/datafusion:parquet 84351420 82356251 1.02
tpcds_q75/datafusion:parquet 98081703 96913319 1.01
tpcds_q76/datafusion:parquet 29967676 29880583 1.00
tpcds_q77/datafusion:parquet 37946428 37593246 1.01
tpcds_q78/datafusion:parquet 111590841 112300934 0.99
tpcds_q79/datafusion:parquet 26217300 25216054 1.04
tpcds_q80/datafusion:parquet 78776166 77040059 1.02
tpcds_q81/datafusion:parquet 30805652 30439932 1.01
tpcds_q82/datafusion:parquet 18834993 18819890 1.00
tpcds_q83/datafusion:parquet 36053730 35982213 1.00
tpcds_q84/datafusion:parquet 38314431 38616020 0.99
tpcds_q85/datafusion:parquet 147022075 143764784 1.02
tpcds_q86/datafusion:parquet 14029986 13962325 1.00
tpcds_q87/datafusion:parquet 40475653 40044328 1.01
tpcds_q88/datafusion:parquet 57717922 59261439 0.97
tpcds_q89/datafusion:parquet 20872711 20483603 1.02
tpcds_q90/datafusion:parquet 14202668 14111993 1.01
tpcds_q91/datafusion:parquet 57389048 56631209 1.01
tpcds_q92/datafusion:parquet 18411920 18296716 1.01
tpcds_q93/datafusion:parquet 31349409 31657068 0.99
tpcds_q94/datafusion:parquet 19589983 19609085 1.00
tpcds_q95/datafusion:parquet 57452301 59488556 0.97
tpcds_q96/datafusion:parquet 12161514 11331545 1.07
tpcds_q97/datafusion:parquet 28776312 29181222 0.99
tpcds_q98/datafusion:parquet 21224436 20980386 1.01
tpcds_q99/datafusion:parquet 24810168 24887950 1.00
duckdb / vortex-file-compressed (0.998x ➖, 1↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26407550 24298877 1.09
tpcds_q02/duckdb:vortex-file-compressed 36997116 33968437 1.09
tpcds_q03/duckdb:vortex-file-compressed 27270195 26765220 1.02
tpcds_q04/duckdb:vortex-file-compressed 95022686 92271190 1.03
tpcds_q05/duckdb:vortex-file-compressed 34232487 32534243 1.05
tpcds_q06/duckdb:vortex-file-compressed 32220882 32359151 1.00
tpcds_q07/duckdb:vortex-file-compressed 21488974 21737484 0.99
tpcds_q08/duckdb:vortex-file-compressed 26805696 26589579 1.01
tpcds_q09/duckdb:vortex-file-compressed 15939671 16017551 1.00
tpcds_q10/duckdb:vortex-file-compressed 37147746 37458672 0.99
tpcds_q11/duckdb:vortex-file-compressed 63039841 65457824 0.96
tpcds_q12/duckdb:vortex-file-compressed 16005127 15962938 1.00
tpcds_q13/duckdb:vortex-file-compressed 33947305 33286736 1.02
tpcds_q14/duckdb:vortex-file-compressed 98001812 95836917 1.02
tpcds_q15/duckdb:vortex-file-compressed 26980196 26742840 1.01
tpcds_q16/duckdb:vortex-file-compressed 26459181 26887239 0.98
tpcds_q17/duckdb:vortex-file-compressed 45033928 46519199 0.97
tpcds_q18/duckdb:vortex-file-compressed 36974303 37302832 0.99
tpcds_q19/duckdb:vortex-file-compressed 32361202 31334780 1.03
tpcds_q20/duckdb:vortex-file-compressed 16709704 16685735 1.00
tpcds_q21/duckdb:vortex-file-compressed 17614571 16208862 1.09
tpcds_q22/duckdb:vortex-file-compressed 76502686 76570477 1.00
tpcds_q23/duckdb:vortex-file-compressed 107093579 108032300 0.99
tpcds_q24/duckdb:vortex-file-compressed 47214649 48328170 0.98
tpcds_q25/duckdb:vortex-file-compressed 49646660 50115385 0.99
tpcds_q26/duckdb:vortex-file-compressed 18447536 19278699 0.96
tpcds_q27/duckdb:vortex-file-compressed 22767089 22578745 1.01
tpcds_q28/duckdb:vortex-file-compressed 12338939 12540154 0.98
tpcds_q29/duckdb:vortex-file-compressed 42288057 43533758 0.97
tpcds_q30/duckdb:vortex-file-compressed 25201638 26992457 0.93
tpcds_q31/duckdb:vortex-file-compressed 28672030 29230205 0.98
tpcds_q32/duckdb:vortex-file-compressed 13494450 13472622 1.00
tpcds_q33/duckdb:vortex-file-compressed 23774405 23391446 1.02
tpcds_q34/duckdb:vortex-file-compressed 24793486 24739362 1.00
tpcds_q35/duckdb:vortex-file-compressed 63510490 64068357 0.99
tpcds_q36/duckdb:vortex-file-compressed 25016405 25195160 0.99
tpcds_q37/duckdb:vortex-file-compressed 20010882 20331685 0.98
tpcds_q38/duckdb:vortex-file-compressed 36643751 37553855 0.98
tpcds_q39/duckdb:vortex-file-compressed 35232161 36112815 0.98
tpcds_q40/duckdb:vortex-file-compressed 19233122 19889641 0.97
tpcds_q41/duckdb:vortex-file-compressed 10055174 10012480 1.00
tpcds_q42/duckdb:vortex-file-compressed 13103807 12933805 1.01
tpcds_q43/duckdb:vortex-file-compressed 21258103 20861325 1.02
tpcds_q44/duckdb:vortex-file-compressed 20548592 21503786 0.96
tpcds_q45/duckdb:vortex-file-compressed 29597342 30210820 0.98
tpcds_q46/duckdb:vortex-file-compressed 31527222 31736792 0.99
tpcds_q47/duckdb:vortex-file-compressed 52627669 52870920 1.00
tpcds_q48/duckdb:vortex-file-compressed 29178843 28807859 1.01
tpcds_q49/duckdb:vortex-file-compressed 32225787 33670851 0.96
tpcds_q50/duckdb:vortex-file-compressed 30469953 29849036 1.02
tpcds_q51/duckdb:vortex-file-compressed 103311539 103464013 1.00
tpcds_q52/duckdb:vortex-file-compressed 12954789 12788782 1.01
tpcds_q53/duckdb:vortex-file-compressed 22400740 22978895 0.97
tpcds_q54/duckdb:vortex-file-compressed 27697198 28943982 0.96
tpcds_q55/duckdb:vortex-file-compressed 11944581 12374568 0.97
tpcds_q56/duckdb:vortex-file-compressed 24583871 25230172 0.97
tpcds_q57/duckdb:vortex-file-compressed 42201195 42437911 0.99
tpcds_q58/duckdb:vortex-file-compressed 30422394 29410392 1.03
tpcds_q59/duckdb:vortex-file-compressed 66900220 66287406 1.01
tpcds_q60/duckdb:vortex-file-compressed 25627430 26584625 0.96
tpcds_q61/duckdb:vortex-file-compressed 29628383 30273678 0.98
tpcds_q62/duckdb:vortex-file-compressed 15955116 15296604 1.04
tpcds_q63/duckdb:vortex-file-compressed 20127696 20502639 0.98
tpcds_q64/duckdb:vortex-file-compressed 102595256 102478786 1.00
tpcds_q65/duckdb:vortex-file-compressed 21769283 22719887 0.96
tpcds_q66/duckdb:vortex-file-compressed 28038050 28274333 0.99
tpcds_q67/duckdb:vortex-file-compressed 142814119 146227706 0.98
tpcds_q68/duckdb:vortex-file-compressed 31249618 31202267 1.00
tpcds_q69/duckdb:vortex-file-compressed 39361377 40235348 0.98
tpcds_q70/duckdb:vortex-file-compressed 38928644 36241131 1.07
tpcds_q71/duckdb:vortex-file-compressed 🚨 24049909 21157938 1.14
tpcds_q72/duckdb:vortex-file-compressed 166938783 170471069 0.98
tpcds_q73/duckdb:vortex-file-compressed 24456845 24282653 1.01
tpcds_q74/duckdb:vortex-file-compressed 41375615 42804262 0.97
tpcds_q75/duckdb:vortex-file-compressed 52591752 49210370 1.07
tpcds_q76/duckdb:vortex-file-compressed 18040661 19147091 0.94
tpcds_q77/duckdb:vortex-file-compressed 22792162 22365690 1.02
tpcds_q78/duckdb:vortex-file-compressed 81931532 77867748 1.05
tpcds_q79/duckdb:vortex-file-compressed 25711557 26364508 0.98
tpcds_q80/duckdb:vortex-file-compressed 46972742 47024377 1.00
tpcds_q81/duckdb:vortex-file-compressed 29020799 29106019 1.00
tpcds_q82/duckdb:vortex-file-compressed 45201219 45979326 0.98
tpcds_q83/duckdb:vortex-file-compressed 26508887 27544320 0.96
tpcds_q84/duckdb:vortex-file-compressed 20209625 20408807 0.99
tpcds_q85/duckdb:vortex-file-compressed 45649996 45740685 1.00
tpcds_q86/duckdb:vortex-file-compressed 17103075 17767162 0.96
tpcds_q87/duckdb:vortex-file-compressed 39467069 39932553 0.99
tpcds_q88/duckdb:vortex-file-compressed 52168316 51251861 1.02
tpcds_q89/duckdb:vortex-file-compressed 21750082 21781152 1.00
tpcds_q90/duckdb:vortex-file-compressed 10266201 10362230 0.99
tpcds_q91/duckdb:vortex-file-compressed 25884629 25759344 1.00
tpcds_q92/duckdb:vortex-file-compressed 19925456 18712741 1.06
tpcds_q93/duckdb:vortex-file-compressed 28686826 29083319 0.99
tpcds_q94/duckdb:vortex-file-compressed 21028266 21235596 0.99
tpcds_q95/duckdb:vortex-file-compressed 🚀 140433068 159611456 0.88
tpcds_q96/duckdb:vortex-file-compressed 12624762 12195867 1.04
tpcds_q97/duckdb:vortex-file-compressed 40755490 39472698 1.03
tpcds_q98/duckdb:vortex-file-compressed 19284739 19490691 0.99
tpcds_q99/duckdb:vortex-file-compressed 25577584 25366322 1.01
duckdb / vortex-compact (0.995x ➖, 1↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25108950 25972547 0.97
tpcds_q02/duckdb:vortex-compact 38940175 37375931 1.04
tpcds_q03/duckdb:vortex-compact 49391867 49415595 1.00
tpcds_q04/duckdb:vortex-compact 104062872 102006793 1.02
tpcds_q05/duckdb:vortex-compact 41092190 40157512 1.02
tpcds_q06/duckdb:vortex-compact 38357445 38196173 1.00
tpcds_q07/duckdb:vortex-compact 33414445 34285709 0.97
tpcds_q08/duckdb:vortex-compact 40326265 40918744 0.99
tpcds_q09/duckdb:vortex-compact 20105061 20948049 0.96
tpcds_q10/duckdb:vortex-compact 51089535 52500158 0.97
tpcds_q11/duckdb:vortex-compact 73287800 75508672 0.97
tpcds_q12/duckdb:vortex-compact 21628398 21688582 1.00
tpcds_q13/duckdb:vortex-compact 54095838 51876229 1.04
tpcds_q14/duckdb:vortex-compact 119449250 117730489 1.01
tpcds_q15/duckdb:vortex-compact 29118621 29399020 0.99
tpcds_q16/duckdb:vortex-compact 26774423 27595540 0.97
tpcds_q17/duckdb:vortex-compact 54765222 54940235 1.00
tpcds_q18/duckdb:vortex-compact 47891859 48426536 0.99
tpcds_q19/duckdb:vortex-compact 43739849 43449273 1.01
tpcds_q20/duckdb:vortex-compact 20279854 20642995 0.98
tpcds_q21/duckdb:vortex-compact 17983623 18878810 0.95
tpcds_q22/duckdb:vortex-compact 77576936 74687952 1.04
tpcds_q23/duckdb:vortex-compact 136692173 137585624 0.99
tpcds_q24/duckdb:vortex-compact 57145005 57110029 1.00
tpcds_q25/duckdb:vortex-compact 81612347 84500497 0.97
tpcds_q26/duckdb:vortex-compact 32768129 32393954 1.01
tpcds_q27/duckdb:vortex-compact 38506078 36893916 1.04
tpcds_q28/duckdb:vortex-compact 33323066 33974664 0.98
tpcds_q29/duckdb:vortex-compact 54731441 53551217 1.02
tpcds_q30/duckdb:vortex-compact 28497478 28421520 1.00
tpcds_q31/duckdb:vortex-compact 36418500 35546432 1.02
tpcds_q32/duckdb:vortex-compact 20962914 20555179 1.02
tpcds_q33/duckdb:vortex-compact 32835009 32915093 1.00
tpcds_q34/duckdb:vortex-compact 30818365 30047689 1.03
tpcds_q35/duckdb:vortex-compact 73938366 74365497 0.99
tpcds_q36/duckdb:vortex-compact 38093848 36552706 1.04
tpcds_q37/duckdb:vortex-compact 24230697 23744330 1.02
tpcds_q38/duckdb:vortex-compact 39932363 41952057 0.95
tpcds_q39/duckdb:vortex-compact 37810688 37999094 1.00
tpcds_q40/duckdb:vortex-compact 24558228 24418227 1.01
tpcds_q41/duckdb:vortex-compact 11543628 11796835 0.98
tpcds_q42/duckdb:vortex-compact 19130901 19333142 0.99
tpcds_q43/duckdb:vortex-compact 30451364 31697968 0.96
tpcds_q44/duckdb:vortex-compact 28463110 28881285 0.99
tpcds_q45/duckdb:vortex-compact 36390682 35811180 1.02
tpcds_q46/duckdb:vortex-compact 45908524 44180960 1.04
tpcds_q47/duckdb:vortex-compact 62485228 63184573 0.99
tpcds_q48/duckdb:vortex-compact 44582881 47235472 0.94
tpcds_q49/duckdb:vortex-compact 47483726 45979332 1.03
tpcds_q50/duckdb:vortex-compact 37556347 37856717 0.99
tpcds_q51/duckdb:vortex-compact 109631152 112266152 0.98
tpcds_q52/duckdb:vortex-compact 19460237 18810076 1.03
tpcds_q53/duckdb:vortex-compact 32020768 32605179 0.98
tpcds_q54/duckdb:vortex-compact 37823758 37095570 1.02
tpcds_q55/duckdb:vortex-compact 18935574 18342004 1.03
tpcds_q56/duckdb:vortex-compact 32576741 31934817 1.02
tpcds_q57/duckdb:vortex-compact 44842639 45838665 0.98
tpcds_q58/duckdb:vortex-compact 38329741 39287019 0.98
tpcds_q59/duckdb:vortex-compact 80297003 87805478 0.91
tpcds_q60/duckdb:vortex-compact 35322165 35439658 1.00
tpcds_q61/duckdb:vortex-compact 53901933 53256401 1.01
tpcds_q62/duckdb:vortex-compact 🚀 20801815 23261742 0.89
tpcds_q63/duckdb:vortex-compact 31465414 30948110 1.02
tpcds_q64/duckdb:vortex-compact 133859697 132429771 1.01
tpcds_q65/duckdb:vortex-compact 31086307 30271693 1.03
tpcds_q66/duckdb:vortex-compact 35548812 37050627 0.96
tpcds_q67/duckdb:vortex-compact 150630347 151427294 0.99
tpcds_q68/duckdb:vortex-compact 43731133 47475931 0.92
tpcds_q69/duckdb:vortex-compact 54905563 55004847 1.00
tpcds_q70/duckdb:vortex-compact 58291458 59307101 0.98
tpcds_q71/duckdb:vortex-compact 29775220 29438255 1.01
tpcds_q72/duckdb:vortex-compact 181928417 180094756 1.01
tpcds_q73/duckdb:vortex-compact 28650856 28295360 1.01
tpcds_q74/duckdb:vortex-compact 49589298 48537093 1.02
tpcds_q75/duckdb:vortex-compact 61357922 61572411 1.00
tpcds_q76/duckdb:vortex-compact 28341062 28789691 0.98
tpcds_q77/duckdb:vortex-compact 37390787 37034156 1.01
tpcds_q78/duckdb:vortex-compact 90796762 92008378 0.99
tpcds_q79/duckdb:vortex-compact 42583991 41037046 1.04
tpcds_q80/duckdb:vortex-compact 68485644 69401667 0.99
tpcds_q81/duckdb:vortex-compact 34986385 33854759 1.03
tpcds_q82/duckdb:vortex-compact 48903728 49685245 0.98
tpcds_q83/duckdb:vortex-compact 34973043 35703249 0.98
tpcds_q84/duckdb:vortex-compact 25988596 27128588 0.96
tpcds_q85/duckdb:vortex-compact 59245270 60885782 0.97
tpcds_q86/duckdb:vortex-compact 21105506 20684201 1.02
tpcds_q87/duckdb:vortex-compact 43531848 45727851 0.95
tpcds_q88/duckdb:vortex-compact 76411605 74472154 1.03
tpcds_q89/duckdb:vortex-compact 32046625 31720897 1.01
tpcds_q90/duckdb:vortex-compact 10677594 10659944 1.00
tpcds_q91/duckdb:vortex-compact 42307490 44216722 0.96
tpcds_q92/duckdb:vortex-compact 41702970 45545203 0.92
tpcds_q93/duckdb:vortex-compact 32953881 32116186 1.03
tpcds_q94/duckdb:vortex-compact 27077969 25823587 1.05
tpcds_q95/duckdb:vortex-compact 162606972 163378734 1.00
tpcds_q96/duckdb:vortex-compact 15780712 16987245 0.93
tpcds_q97/duckdb:vortex-compact 42365190 40008968 1.06
tpcds_q98/duckdb:vortex-compact 26809854 26884673 1.00
tpcds_q99/duckdb:vortex-compact 28785875 29035364 0.99
duckdb / parquet (0.996x ➖, 0↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29059403 29847547 0.97
tpcds_q02/duckdb:parquet 23770794 23955159 0.99
tpcds_q03/duckdb:parquet 12471728 12780996 0.98
tpcds_q04/duckdb:parquet 172360570 169162959 1.02
tpcds_q05/duckdb:parquet 31028924 31463247 0.99
tpcds_q06/duckdb:parquet 32828096 34125305 0.96
tpcds_q07/duckdb:parquet 24320795 23781795 1.02
tpcds_q08/duckdb:parquet 30096473 29722172 1.01
tpcds_q09/duckdb:parquet 44970785 44964282 1.00
tpcds_q10/duckdb:parquet 37872114 38165212 0.99
tpcds_q11/duckdb:parquet 93127642 93360650 1.00
tpcds_q12/duckdb:parquet 17109396 17320461 0.99
tpcds_q13/duckdb:parquet 35028315 35224046 0.99
tpcds_q14/duckdb:parquet 102602982 101727355 1.01
tpcds_q15/duckdb:parquet 30307524 31633357 0.96
tpcds_q16/duckdb:parquet 22933508 22694016 1.01
tpcds_q17/duckdb:parquet 38780808 39472048 0.98
tpcds_q18/duckdb:parquet 47824745 48721170 0.98
tpcds_q19/duckdb:parquet 31540053 31950715 0.99
tpcds_q20/duckdb:parquet 18512486 18730233 0.99
tpcds_q21/duckdb:parquet 11403208 11849466 0.96
tpcds_q22/duckdb:parquet 70841429 72481313 0.98
tpcds_q23/duckdb:parquet 79379706 81341997 0.98
tpcds_q24/duckdb:parquet 46655064 47047998 0.99
tpcds_q25/duckdb:parquet 36161227 36038294 1.00
tpcds_q26/duckdb:parquet 38515388 38892189 0.99
tpcds_q27/duckdb:parquet 52158749 53973081 0.97
tpcds_q28/duckdb:parquet 42975058 43239971 0.99
tpcds_q29/duckdb:parquet 36921928 37194488 0.99
tpcds_q30/duckdb:parquet 37306088 37854251 0.99
tpcds_q31/duckdb:parquet 29326678 27790768 1.06
tpcds_q32/duckdb:parquet 12313387 12712755 0.97
tpcds_q33/duckdb:parquet 23970969 24533336 0.98
tpcds_q34/duckdb:parquet 24260324 22613116 1.07
tpcds_q35/duckdb:parquet 61039671 63018838 0.97
tpcds_q36/duckdb:parquet 22957384 22633549 1.01
tpcds_q37/duckdb:parquet 13605250 14909031 0.91
tpcds_q38/duckdb:parquet 36046652 37418803 0.96
tpcds_q39/duckdb:parquet 32242978 31994278 1.01
tpcds_q40/duckdb:parquet 19415155 19538286 0.99
tpcds_q41/duckdb:parquet 8858166 8904143 0.99
tpcds_q42/duckdb:parquet 12283296 12590130 0.98
tpcds_q43/duckdb:parquet 16741547 18080357 0.93
tpcds_q44/duckdb:parquet 25469121 25873942 0.98
tpcds_q45/duckdb:parquet 28308028 28892430 0.98
tpcds_q46/duckdb:parquet 47186933 48548300 0.97
tpcds_q47/duckdb:parquet 49200452 51173334 0.96
tpcds_q48/duckdb:parquet 32010569 32595374 0.98
tpcds_q49/duckdb:parquet 27891283 27843763 1.00
tpcds_q50/duckdb:parquet 25937276 26390184 0.98
tpcds_q51/duckdb:parquet 104107861 105250196 0.99
tpcds_q52/duckdb:parquet 12460209 13397607 0.93
tpcds_q53/duckdb:parquet 19149380 18762508 1.02
tpcds_q54/duckdb:parquet 29228222 28875839 1.01
tpcds_q55/duckdb:parquet 12665892 12792656 0.99
tpcds_q56/duckdb:parquet 24264754 24439250 0.99
tpcds_q57/duckdb:parquet 37745866 38285397 0.99
tpcds_q58/duckdb:parquet 26233804 26710660 0.98
tpcds_q59/duckdb:parquet 36015570 36349968 0.99
tpcds_q60/duckdb:parquet 24959112 25106365 0.99
tpcds_q61/duckdb:parquet 36223838 33757147 1.07
tpcds_q62/duckdb:parquet 12638944 12793118 0.99
tpcds_q63/duckdb:parquet 17790754 17810330 1.00
tpcds_q64/duckdb:parquet 75471104 77556780 0.97
tpcds_q65/duckdb:parquet 23382173 22662053 1.03
tpcds_q66/duckdb:parquet 31157245 29750888 1.05
tpcds_q67/duckdb:parquet 138106578 138181020 1.00
tpcds_q68/duckdb:parquet 39584730 39410128 1.00
tpcds_q69/duckdb:parquet 38969391 38388471 1.02
tpcds_q70/duckdb:parquet 22807798 22449521 1.02
tpcds_q71/duckdb:parquet 23000227 23240845 0.99
tpcds_q72/duckdb:parquet 166906492 166696639 1.00
tpcds_q73/duckdb:parquet 20357698 19966155 1.02
tpcds_q74/duckdb:parquet 125115757 125953622 0.99
tpcds_q75/duckdb:parquet 57503454 58011905 0.99
tpcds_q76/duckdb:parquet 21832583 21808319 1.00
tpcds_q77/duckdb:parquet 25152364 25178093 1.00
tpcds_q78/duckdb:parquet 77175749 77823835 0.99
tpcds_q79/duckdb:parquet 29915007 29793001 1.00
tpcds_q80/duckdb:parquet 46213227 43803724 1.06
tpcds_q81/duckdb:parquet 35223942 35331971 1.00
tpcds_q82/duckdb:parquet 16828254 17335726 0.97
tpcds_q83/duckdb:parquet 18297610 18261099 1.00
tpcds_q84/duckdb:parquet 20589106 20668588 1.00
tpcds_q85/duckdb:parquet 41901092 42063118 1.00
tpcds_q86/duckdb:parquet 13910735 13628993 1.02
tpcds_q87/duckdb:parquet 39043092 39647847 0.98
tpcds_q88/duckdb:parquet 54032893 53661656 1.01
tpcds_q89/duckdb:parquet 20369244 20790462 0.98
tpcds_q90/duckdb:parquet 9353916 8716124 1.07
tpcds_q91/duckdb:parquet 26180703 25403311 1.03
tpcds_q92/duckdb:parquet 13219156 13346476 0.99
tpcds_q93/duckdb:parquet 32161413 32523224 0.99
tpcds_q94/duckdb:parquet 18251475 18539341 0.98
tpcds_q95/duckdb:parquet 🚨 149819453 123401970 1.21
tpcds_q96/duckdb:parquet 11017630 10724880 1.03
tpcds_q97/duckdb:parquet 37232697 38205837 0.97
tpcds_q98/duckdb:parquet 24520153 24558199 1.00
tpcds_q99/duckdb:parquet 20283760 20603013 0.98
duckdb / duckdb (1.000x ➖, 2↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22486696 21204319 1.06
tpcds_q02/duckdb:duckdb 19206012 19146998 1.00
tpcds_q03/duckdb:duckdb 10459106 10051569 1.04
tpcds_q04/duckdb:duckdb 178701521 177620135 1.01
tpcds_q05/duckdb:duckdb 22040720 22208685 0.99
tpcds_q06/duckdb:duckdb 28660163 28353086 1.01
tpcds_q07/duckdb:duckdb 41015265 40323832 1.02
tpcds_q08/duckdb:duckdb 120529404 120361777 1.00
tpcds_q09/duckdb:duckdb 20736242 20513528 1.01
tpcds_q10/duckdb:duckdb 28500968 26825316 1.06
tpcds_q11/duckdb:duckdb 95056046 89359816 1.06
tpcds_q12/duckdb:duckdb 14046955 13881636 1.01
tpcds_q13/duckdb:duckdb 25834676 26778350 0.96
tpcds_q14/duckdb:duckdb 93269853 92635312 1.01
tpcds_q15/duckdb:duckdb 24394156 25750632 0.95
tpcds_q16/duckdb:duckdb 19251568 19393958 0.99
tpcds_q17/duckdb:duckdb 24541464 23768545 1.03
tpcds_q18/duckdb:duckdb 48084730 46447783 1.04
tpcds_q19/duckdb:duckdb 20793031 20386876 1.02
tpcds_q20/duckdb:duckdb 14320890 14416732 0.99
tpcds_q21/duckdb:duckdb 7892406 7710221 1.02
tpcds_q22/duckdb:duckdb 67367291 63659205 1.06
tpcds_q23/duckdb:duckdb 76102038 75688891 1.01
tpcds_q24/duckdb:duckdb 25686190 25926465 0.99
tpcds_q25/duckdb:duckdb 18675701 18868777 0.99
tpcds_q26/duckdb:duckdb 28500315 28780561 0.99
tpcds_q27/duckdb:duckdb 41354673 41233909 1.00
tpcds_q28/duckdb:duckdb 26624059 24870890 1.07
tpcds_q29/duckdb:duckdb 24011760 23538789 1.02
tpcds_q30/duckdb:duckdb 30922997 31184547 0.99
tpcds_q31/duckdb:duckdb 51436187 52804014 0.97
tpcds_q32/duckdb:duckdb 7848812 8126140 0.97
tpcds_q33/duckdb:duckdb 15887995 16216729 0.98
tpcds_q34/duckdb:duckdb 18927548 19066667 0.99
tpcds_q35/duckdb:duckdb 37895106 37018851 1.02
tpcds_q36/duckdb:duckdb 71296384 71802271 0.99
tpcds_q37/duckdb:duckdb 8943327 8773751 1.02
tpcds_q38/duckdb:duckdb 33524454 34374801 0.98
tpcds_q39/duckdb:duckdb 28712943 28419449 1.01
tpcds_q40/duckdb:duckdb 14471298 14931471 0.97
tpcds_q41/duckdb:duckdb 10237203 9510815 1.08
tpcds_q42/duckdb:duckdb 9127447 9994923 0.91
tpcds_q43/duckdb:duckdb 14897174 14788421 1.01
tpcds_q44/duckdb:duckdb 15398261 15663843 0.98
tpcds_q45/duckdb:duckdb 18814526 19293950 0.98
tpcds_q46/duckdb:duckdb 38217698 39254469 0.97
tpcds_q47/duckdb:duckdb 46822315 47024829 1.00
tpcds_q48/duckdb:duckdb 25037945 25392719 0.99
tpcds_q49/duckdb:duckdb 21392592 21970821 0.97
tpcds_q50/duckdb:duckdb 16286343 16368805 0.99
tpcds_q51/duckdb:duckdb 101395188 98717236 1.03
tpcds_q52/duckdb:duckdb 9634304 9910259 0.97
tpcds_q53/duckdb:duckdb 17299717 17618104 0.98
tpcds_q54/duckdb:duckdb 18283930 19273145 0.95
tpcds_q55/duckdb:duckdb 8930949 9267972 0.96
tpcds_q56/duckdb:duckdb 16778315 16621497 1.01
tpcds_q57/duckdb:duckdb 36575297 36133796 1.01
tpcds_q58/duckdb:duckdb 17486110 16672282 1.05
tpcds_q59/duckdb:duckdb 36640668 37124323 0.99
tpcds_q60/duckdb:duckdb 18171279 18622223 0.98
tpcds_q61/duckdb:duckdb 17500590 17528177 1.00
tpcds_q62/duckdb:duckdb 9975204 9852142 1.01
tpcds_q63/duckdb:duckdb 16797688 16749606 1.00
tpcds_q64/duckdb:duckdb 58408166 57408878 1.02
tpcds_q65/duckdb:duckdb 36143257 36528134 0.99
tpcds_q66/duckdb:duckdb 26250262 26481494 0.99
tpcds_q67/duckdb:duckdb 135429544 132320848 1.02
tpcds_q68/duckdb:duckdb 26424710 27633891 0.96
tpcds_q69/duckdb:duckdb 27744826 27698471 1.00
tpcds_q70/duckdb:duckdb 16677917 16133839 1.03
tpcds_q71/duckdb:duckdb 16076626 16609575 0.97
tpcds_q72/duckdb:duckdb 46591095 45499544 1.02
tpcds_q73/duckdb:duckdb 14038048 13504226 1.04
tpcds_q74/duckdb:duckdb 146465400 145639557 1.01
tpcds_q75/duckdb:duckdb 46456149 45307840 1.03
tpcds_q76/duckdb:duckdb 14339190 14317460 1.00
tpcds_q77/duckdb:duckdb 15828863 15252415 1.04
tpcds_q78/duckdb:duckdb 66070111 65715568 1.01
tpcds_q79/duckdb:duckdb 19641115 20241387 0.97
tpcds_q80/duckdb:duckdb 🚀 31068880 35418788 0.88
tpcds_q81/duckdb:duckdb 41716086 40001657 1.04
tpcds_q82/duckdb:duckdb 10618110 10292489 1.03
tpcds_q83/duckdb:duckdb 11522672 11158424 1.03
tpcds_q84/duckdb:duckdb 14481465 14947826 0.97
tpcds_q85/duckdb:duckdb 26568067 25941385 1.02
tpcds_q86/duckdb:duckdb 11852741 12359990 0.96
tpcds_q87/duckdb:duckdb 36403818 36055414 1.01
tpcds_q88/duckdb:duckdb 30912649 29991669 1.03
tpcds_q89/duckdb:duckdb 22114406 22036713 1.00
tpcds_q90/duckdb:duckdb 6152915 6417790 0.96
tpcds_q91/duckdb:duckdb 15258187 14919615 1.02
tpcds_q92/duckdb:duckdb 9840363 9764293 1.01
tpcds_q93/duckdb:duckdb 23574490 23823626 0.99
tpcds_q94/duckdb:duckdb 14380643 15634810 0.92
tpcds_q95/duckdb:duckdb 🚀 110675660 123964233 0.89
tpcds_q96/duckdb:duckdb 5681719 5728526 0.99
tpcds_q97/duckdb:duckdb 31681296 31913546 0.99
tpcds_q98/duckdb:duckdb 20505126 19894148 1.03
tpcds_q99/duckdb:duckdb 16646107 16692399 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.8% -5.4% +3.8% +19.1% ➖ noise
1 datafusion:vortex-file-compressed +0.9% -5.4% +6.6% +19.0% ➖ noise
1 duckdb:duckdb +6.0% -5.4% +12.1% +21.4% ➖ noise
1 duckdb:vortex-compact -3.3% -5.4% +2.2% +23.1% ➖ noise
1 duckdb:vortex-file-compressed +8.7% -5.4% +14.8% +26.8% ➖ noise
2 datafusion:vortex-compact -2.5% -1.4% -1.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.7% -1.4% +0.7% +10.0% ➖ noise
2 duckdb:duckdb +0.3% -1.4% +1.7% +10.0% ➖ noise
2 duckdb:vortex-compact +4.2% -1.4% +5.6% +29.4% ➖ noise
2 duckdb:vortex-file-compressed +8.9% -1.4% +10.4% +28.7% ➖ noise
3 datafusion:vortex-compact -0.7% -4.6% +4.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -2.3% -4.6% +2.4% +10.0% ➖ noise
3 duckdb:duckdb +4.1% -4.6% +9.0% +10.0% ➖ noise
3 duckdb:vortex-compact -0.0% -4.6% +4.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.9% -4.6% +6.8% +10.0% ➖ noise
4 datafusion:vortex-compact -1.7% +0.4% -2.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.6% +0.4% +0.2% +10.1% ➖ noise
4 duckdb:duckdb +0.6% +0.4% +0.2% +10.0% ➖ noise
4 duckdb:vortex-compact +2.0% +0.4% +1.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.0% +0.4% +2.5% +10.0% ➖ noise
5 datafusion:vortex-compact -1.5% -1.4% -0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.2% -1.4% +1.7% +11.6% ➖ noise
5 duckdb:duckdb -0.8% -1.4% +0.7% +16.4% ➖ noise
5 duckdb:vortex-compact +2.3% -1.4% +3.8% +17.3% ➖ noise
5 duckdb:vortex-file-compressed +5.2% -1.4% +6.7% +10.0% ➖ noise
6 datafusion:vortex-compact -1.7% -1.8% +0.1% +10.9% ➖ noise
6 datafusion:vortex-file-compressed -5.3% -1.8% -3.5% +10.0% ➖ noise
6 duckdb:duckdb +1.1% -1.8% +3.0% +13.5% ➖ noise
6 duckdb:vortex-compact +0.4% -1.8% +2.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% -1.8% +1.4% +10.0% ➖ noise
7 datafusion:vortex-compact -4.4% +2.5% -6.8% +17.3% ➖ noise
7 datafusion:vortex-file-compressed -0.7% +2.5% -3.2% +10.0% ➖ noise
7 duckdb:duckdb +1.7% +2.5% -0.8% +10.0% ➖ noise
7 duckdb:vortex-compact -2.5% +2.5% -4.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.1% +2.5% -3.6% +10.0% ➖ noise
8 datafusion:vortex-compact -1.8% +3.6% -5.1% +15.5% ➖ noise
8 datafusion:vortex-file-compressed -0.5% +3.6% -3.9% +13.4% ➖ noise
8 duckdb:duckdb +0.1% +3.6% -3.3% +10.0% ➖ noise
8 duckdb:vortex-compact -1.4% +3.6% -4.8% +15.6% ➖ noise
8 duckdb:vortex-file-compressed +0.8% +3.6% -2.7% +23.3% ➖ noise
9 datafusion:vortex-compact +0.4% +2.5% -2.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -3.0% +2.5% -5.4% +10.1% ➖ noise
9 duckdb:duckdb +1.1% +2.5% -1.4% +10.0% ➖ noise
9 duckdb:vortex-compact -4.0% +2.5% -6.4% +10.3% ➖ noise
9 duckdb:vortex-file-compressed -0.5% +2.5% -2.9% +13.9% ➖ noise
10 datafusion:vortex-compact +3.0% +1.3% +1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.3% +1.3% +1.0% +10.0% ➖ noise
10 duckdb:duckdb +6.2% +1.3% +4.9% +10.0% ➖ noise
10 duckdb:vortex-compact -2.7% +1.3% -3.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.8% +1.3% -2.1% +10.0% ➖ noise
11 datafusion:vortex-compact -5.1% +0.3% -5.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -4.8% +0.3% -5.0% +10.0% ➖ noise
11 duckdb:duckdb +6.4% +0.3% +6.1% +10.0% ➖ noise
11 duckdb:vortex-compact -2.9% +0.3% -3.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -3.7% +0.3% -3.9% +10.0% ➖ noise
12 datafusion:vortex-compact -0.2% +4.0% -4.0% +13.0% ➖ noise
12 datafusion:vortex-file-compressed -3.3% +4.0% -7.0% +15.1% ➖ noise
12 duckdb:duckdb +1.2% +4.0% -2.7% +10.0% ➖ noise
12 duckdb:vortex-compact -0.3% +4.0% -4.1% +14.2% ➖ noise
12 duckdb:vortex-file-compressed +0.3% +4.0% -3.6% +17.8% ➖ noise
13 datafusion:vortex-compact +19.1% -0.2% +19.3% +17.0% 🚨 regression
13 datafusion:vortex-file-compressed -3.6% -0.2% -3.5% +10.0% ➖ noise
13 duckdb:duckdb -3.5% -0.2% -3.4% +10.0% ➖ noise
13 duckdb:vortex-compact +4.3% -0.2% +4.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.0% -0.2% +2.1% +11.9% ➖ noise
14 datafusion:vortex-compact +1.4% +0.1% +1.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.5% +0.1% +1.4% +10.0% ➖ noise
14 duckdb:duckdb +0.7% +0.1% +0.6% +10.0% ➖ noise
14 duckdb:vortex-compact +1.5% +0.1% +1.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.3% +0.1% +2.1% +10.0% ➖ noise
15 datafusion:vortex-compact +1.4% -2.8% +4.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +6.0% -2.8% +9.0% +15.0% ➖ noise
15 duckdb:duckdb -5.3% -2.8% -2.6% +10.0% ➖ noise
15 duckdb:vortex-compact -1.0% -2.8% +1.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.9% -2.8% +3.7% +10.0% ➖ noise
16 datafusion:vortex-compact -3.9% +0.8% -4.6% +12.9% ➖ noise
16 datafusion:vortex-file-compressed +2.6% +0.8% +1.8% +10.0% ➖ noise
16 duckdb:duckdb -0.7% +0.8% -1.5% +10.9% ➖ noise
16 duckdb:vortex-compact -3.0% +0.8% -3.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.6% +0.8% -2.3% +10.5% ➖ noise
17 datafusion:vortex-compact +0.0% -3.1% +3.3% +13.1% ➖ noise
17 datafusion:vortex-file-compressed +2.2% -3.1% +5.5% +10.0% ➖ noise
17 duckdb:duckdb +3.3% -3.1% +6.6% +10.0% ➖ noise
17 duckdb:vortex-compact -0.3% -3.1% +2.9% +15.5% ➖ noise
17 duckdb:vortex-file-compressed -3.2% -3.1% -0.0% +10.0% ➖ noise
18 datafusion:vortex-compact +0.6% -1.6% +2.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.6% -1.6% -0.0% +10.0% ➖ noise
18 duckdb:duckdb +3.5% -1.6% +5.2% +10.0% ➖ noise
18 duckdb:vortex-compact -1.1% -1.6% +0.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.9% -1.6% +0.7% +10.0% ➖ noise
19 datafusion:vortex-compact -10.4% +0.0% -10.4% +14.2% ➖ noise
19 datafusion:vortex-file-compressed -3.7% +0.0% -3.8% +16.8% ➖ noise
19 duckdb:duckdb +2.0% +0.0% +1.9% +10.0% ➖ noise
19 duckdb:vortex-compact +0.7% +0.0% +0.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +3.3% +0.0% +3.2% +13.1% ➖ noise
20 datafusion:vortex-compact -1.5% +4.5% -5.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +4.2% +4.5% -0.3% +10.0% ➖ noise
20 duckdb:duckdb -0.7% +4.5% -4.9% +10.0% ➖ noise
20 duckdb:vortex-compact -1.8% +4.5% -6.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.1% +4.5% -4.2% +10.0% ➖ noise
21 datafusion:vortex-compact +3.2% -0.6% +3.8% +14.3% ➖ noise
21 datafusion:vortex-file-compressed +0.6% -0.6% +1.2% +10.0% ➖ noise
21 duckdb:duckdb +2.4% -0.6% +3.0% +13.6% ➖ noise
21 duckdb:vortex-compact -4.7% -0.6% -4.2% +29.4% ➖ noise
21 duckdb:vortex-file-compressed +8.7% -0.6% +9.3% +10.6% ➖ noise
22 datafusion:vortex-compact -0.7% +1.5% -2.2% +23.0% ➖ noise
22 datafusion:vortex-file-compressed -3.1% +1.5% -4.5% +10.8% ➖ noise
22 duckdb:duckdb +5.8% +1.5% +4.3% +10.1% ➖ noise
22 duckdb:vortex-compact +3.9% +1.5% +2.4% +11.8% ➖ noise
22 duckdb:vortex-file-compressed -0.1% +1.5% -1.5% +12.4% ➖ noise
23 datafusion:vortex-compact -1.0% -0.5% -0.5% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +1.4% -0.5% +1.9% +10.0% ➖ noise
23 duckdb:duckdb +0.5% -0.5% +1.1% +10.0% ➖ noise
23 duckdb:vortex-compact -0.6% -0.5% -0.1% +15.5% ➖ noise
23 duckdb:vortex-file-compressed -0.9% -0.5% -0.4% +15.0% ➖ noise
24 datafusion:vortex-compact +0.4% -1.1% +1.6% +12.0% ➖ noise
24 datafusion:vortex-file-compressed +3.2% -1.1% +4.4% +10.0% ➖ noise
24 duckdb:duckdb -0.9% -1.1% +0.2% +10.0% ➖ noise
24 duckdb:vortex-compact +0.1% -1.1% +1.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -2.3% -1.1% -1.2% +10.0% ➖ noise
25 datafusion:vortex-compact -4.1% +2.0% -5.9% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +0.5% +2.0% -1.5% +10.0% ➖ noise
25 duckdb:duckdb -1.0% +2.0% -2.9% +10.0% ➖ noise
25 duckdb:vortex-compact -3.4% +2.0% -5.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.9% +2.0% -2.9% +14.5% ➖ noise
26 datafusion:vortex-compact -2.3% +0.3% -2.6% +10.1% ➖ noise
26 datafusion:vortex-file-compressed +2.6% +0.3% +2.3% +10.0% ➖ noise
26 duckdb:duckdb -1.0% +0.3% -1.3% +10.0% ➖ noise
26 duckdb:vortex-compact +1.2% +0.3% +0.9% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -4.3% +0.3% -4.6% +10.0% ➖ noise
27 datafusion:vortex-compact +1.2% -0.9% +2.2% +12.2% ➖ noise
27 datafusion:vortex-file-compressed -2.5% -0.9% -1.6% +11.0% ➖ noise
27 duckdb:duckdb +0.3% -0.9% +1.2% +10.0% ➖ noise
27 duckdb:vortex-compact +4.4% -0.9% +5.4% +12.2% ➖ noise
27 duckdb:vortex-file-compressed +0.8% -0.9% +1.8% +22.0% ➖ noise
28 datafusion:vortex-compact -4.9% -2.3% -2.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -6.2% -2.3% -3.9% +10.0% ➖ noise
28 duckdb:duckdb +7.0% -2.3% +9.6% +10.0% ➖ noise
28 duckdb:vortex-compact -1.9% -2.3% +0.4% +22.3% ➖ noise
28 duckdb:vortex-file-compressed -1.6% -2.3% +0.7% +10.0% ➖ noise
29 datafusion:vortex-compact +3.7% +1.3% +2.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.3% +1.3% -2.6% +10.0% ➖ noise
29 duckdb:duckdb +2.0% +1.3% +0.7% +14.3% ➖ noise
29 duckdb:vortex-compact +2.2% +1.3% +0.9% +17.6% ➖ noise
29 duckdb:vortex-file-compressed -2.9% +1.3% -4.1% +10.0% ➖ noise
30 datafusion:vortex-compact -1.1% -0.8% -0.3% +11.1% ➖ noise
30 datafusion:vortex-file-compressed -5.6% -0.8% -4.8% +21.4% ➖ noise
30 duckdb:duckdb -0.8% -0.8% -0.0% +10.0% ➖ noise
30 duckdb:vortex-compact +0.3% -0.8% +1.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -6.6% -0.8% -5.9% +24.4% ➖ noise
31 datafusion:vortex-compact -1.5% +3.0% -4.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.6% +3.0% -2.3% +10.0% ➖ noise
31 duckdb:duckdb -2.6% +3.0% -5.4% +10.0% ➖ noise
31 duckdb:vortex-compact +2.5% +3.0% -0.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -1.9% +3.0% -4.8% +10.0% ➖ noise
32 datafusion:vortex-compact +0.4% -1.2% +1.6% +23.4% ➖ noise
32 datafusion:vortex-file-compressed -2.5% -1.2% -1.4% +10.0% ➖ noise
32 duckdb:duckdb -3.4% -1.2% -2.3% +15.1% ➖ noise
32 duckdb:vortex-compact +2.0% -1.2% +3.2% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +0.2% -1.2% +1.3% +10.0% ➖ noise
33 datafusion:vortex-compact -0.7% -2.2% +1.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.0% -2.2% +3.3% +14.1% ➖ noise
33 duckdb:duckdb -2.0% -2.2% +0.2% +10.0% ➖ noise
33 duckdb:vortex-compact -0.2% -2.2% +2.0% +14.4% ➖ noise
33 duckdb:vortex-file-compressed +1.6% -2.2% +4.0% +10.0% ➖ noise
34 datafusion:vortex-compact +0.1% +2.7% -2.6% +10.4% ➖ noise
34 datafusion:vortex-file-compressed -1.0% +2.7% -3.7% +10.0% ➖ noise
34 duckdb:duckdb -0.7% +2.7% -3.4% +11.1% ➖ noise
34 duckdb:vortex-compact +2.6% +2.7% -0.1% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +0.2% +2.7% -2.4% +10.0% ➖ noise
35 datafusion:vortex-compact +1.0% -2.1% +3.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -1.9% -2.1% +0.2% +10.0% ➖ noise
35 duckdb:duckdb +2.4% -2.1% +4.6% +10.0% ➖ noise
35 duckdb:vortex-compact -0.6% -2.1% +1.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.9% -2.1% +1.2% +10.1% ➖ noise
36 datafusion:vortex-compact +4.9% +1.2% +3.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.2% +1.2% -1.0% +10.0% ➖ noise
36 duckdb:duckdb -0.7% +1.2% -1.9% +10.0% ➖ noise
36 duckdb:vortex-compact +4.2% +1.2% +3.0% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -0.7% +1.2% -1.9% +10.0% ➖ noise
37 datafusion:vortex-compact -3.0% -4.3% +1.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -2.9% -4.3% +1.5% +10.0% ➖ noise
37 duckdb:duckdb +1.9% -4.3% +6.6% +10.0% ➖ noise
37 duckdb:vortex-compact +2.0% -4.3% +6.7% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -1.6% -4.3% +2.9% +10.0% ➖ noise
38 datafusion:vortex-compact -4.6% -1.6% -3.0% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -2.9% -1.6% -1.3% +10.0% ➖ noise
38 duckdb:duckdb -2.5% -1.6% -0.9% +11.3% ➖ noise
38 duckdb:vortex-compact -4.8% -1.6% -3.2% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -2.4% -1.6% -0.8% +10.0% ➖ noise
39 datafusion:vortex-compact +2.3% +0.1% +2.2% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +2.0% +0.1% +1.9% +10.0% ➖ noise
39 duckdb:duckdb +1.0% +0.1% +0.9% +15.3% ➖ noise
39 duckdb:vortex-compact -0.5% +0.1% -0.6% +15.7% ➖ noise
39 duckdb:vortex-file-compressed -2.4% +0.1% -2.5% +13.5% ➖ noise
40 datafusion:vortex-compact +0.0% +0.8% -0.8% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +2.2% +0.8% +1.4% +13.7% ➖ noise
40 duckdb:duckdb -3.1% +0.8% -3.9% +10.0% ➖ noise
40 duckdb:vortex-compact +0.6% +0.8% -0.3% +12.2% ➖ noise
40 duckdb:vortex-file-compressed -3.3% +0.8% -4.1% +10.0% ➖ noise
41 datafusion:vortex-compact +2.0% -0.9% +2.9% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +5.0% -0.9% +6.0% +10.0% ➖ noise
41 duckdb:duckdb +7.6% -0.9% +8.6% +10.0% ➖ noise
41 duckdb:vortex-compact -2.1% -0.9% -1.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.4% -0.9% +1.3% +10.0% ➖ noise
42 datafusion:vortex-compact +1.1% +1.2% -0.1% +12.8% ➖ noise
42 datafusion:vortex-file-compressed +1.2% +1.2% -0.1% +10.0% ➖ noise
42 duckdb:duckdb -8.7% +1.2% -9.8% +14.5% ➖ noise
42 duckdb:vortex-compact -1.0% +1.2% -2.3% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +1.3% +1.2% +0.1% +10.0% ➖ noise
43 datafusion:vortex-compact -1.5% -7.8% +6.9% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +0.7% -7.8% +9.3% +10.0% ➖ noise
43 duckdb:duckdb +0.7% -7.8% +9.3% +10.0% ➖ noise
43 duckdb:vortex-compact -3.9% -7.8% +4.2% +14.6% ➖ noise
43 duckdb:vortex-file-compressed +1.9% -7.8% +10.6% +13.9% ➖ noise
44 datafusion:vortex-compact -0.2% -1.6% +1.4% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -2.3% -1.6% -0.7% +10.0% ➖ noise
44 duckdb:duckdb -1.7% -1.6% -0.1% +10.0% ➖ noise
44 duckdb:vortex-compact -1.4% -1.6% +0.2% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -4.4% -1.6% -2.9% +10.0% ➖ noise
45 datafusion:vortex-compact -0.6% -0.6% -0.0% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +0.3% -0.6% +0.9% +10.0% ➖ noise
45 duckdb:duckdb -2.5% -0.6% -1.9% +10.0% ➖ noise
45 duckdb:vortex-compact +1.6% -0.6% +2.2% +11.8% ➖ noise
45 duckdb:vortex-file-compressed -2.0% -0.6% -1.5% +10.0% ➖ noise
46 datafusion:vortex-compact +8.1% -1.1% +9.2% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -4.7% -1.1% -3.7% +10.7% ➖ noise
46 duckdb:duckdb -2.6% -1.1% -1.6% +10.6% ➖ noise
46 duckdb:vortex-compact +3.9% -1.1% +5.0% +12.6% ➖ noise
46 duckdb:vortex-file-compressed -0.7% -1.1% +0.4% +13.4% ➖ noise
47 datafusion:vortex-compact -1.5% -0.9% -0.6% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.0% -0.9% +1.9% +10.0% ➖ noise
47 duckdb:duckdb -0.4% -0.9% +0.5% +10.0% ➖ noise
47 duckdb:vortex-compact -1.1% -0.9% -0.2% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -0.5% -0.9% +0.5% +10.0% ➖ noise
48 datafusion:vortex-compact +1.9% +0.5% +1.4% +21.7% ➖ noise
48 datafusion:vortex-file-compressed +0.5% +0.5% +0.0% +12.4% ➖ noise
48 duckdb:duckdb -1.4% +0.5% -1.9% +10.0% ➖ noise
48 duckdb:vortex-compact -5.6% +0.5% -6.1% +17.3% ➖ noise
48 duckdb:vortex-file-compressed +1.3% +0.5% +0.8% +10.0% ➖ noise
49 datafusion:vortex-compact -0.2% +1.1% -1.2% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -2.0% +1.1% -3.0% +10.2% ➖ noise
49 duckdb:duckdb -2.6% +1.1% -3.7% +10.0% ➖ noise
49 duckdb:vortex-compact +3.3% +1.1% +2.2% +10.6% ➖ noise
49 duckdb:vortex-file-compressed -4.3% +1.1% -5.3% +12.9% ➖ noise
50 datafusion:vortex-compact -0.6% -0.6% -0.1% +11.9% ➖ noise
50 datafusion:vortex-file-compressed +4.6% -0.6% +5.2% +10.0% ➖ noise
50 duckdb:duckdb -0.5% -0.6% +0.1% +11.6% ➖ noise
50 duckdb:vortex-compact -0.8% -0.6% -0.2% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +2.1% -0.6% +2.7% +10.0% ➖ noise
51 datafusion:vortex-compact -2.5% +0.1% -2.5% +12.9% ➖ noise
51 datafusion:vortex-file-compressed +1.1% +0.1% +1.0% +10.2% ➖ noise
51 duckdb:duckdb +2.7% +0.1% +2.6% +10.4% ➖ noise
51 duckdb:vortex-compact -2.3% +0.1% -2.4% +27.2% ➖ noise
51 duckdb:vortex-file-compressed -0.1% +0.1% -0.2% +18.4% ➖ noise
52 datafusion:vortex-compact +2.8% -1.9% +4.8% +10.0% ➖ noise
52 datafusion:vortex-file-compressed -4.6% -1.9% -2.8% +21.7% ➖ noise
52 duckdb:duckdb -2.8% -1.9% -0.9% +12.9% ➖ noise
52 duckdb:vortex-compact +3.5% -1.9% +5.5% +10.0% ➖ noise
52 duckdb:vortex-file-compressed +1.3% -1.9% +3.3% +18.9% ➖ noise
53 datafusion:vortex-compact +4.7% +0.3% +4.4% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -2.2% +0.3% -2.5% +10.0% ➖ noise
53 duckdb:duckdb -1.8% +0.3% -2.1% +10.0% ➖ noise
53 duckdb:vortex-compact -1.8% +0.3% -2.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -2.5% +0.3% -2.8% +10.0% ➖ noise
54 datafusion:vortex-compact +1.1% +0.9% +0.2% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -1.8% +0.9% -2.6% +10.9% ➖ noise
54 duckdb:duckdb -5.1% +0.9% -6.0% +10.0% ➖ noise
54 duckdb:vortex-compact +2.0% +0.9% +1.1% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -4.3% +0.9% -5.1% +10.0% ➖ noise
55 datafusion:vortex-compact +1.4% -0.5% +1.9% +14.6% ➖ noise
55 datafusion:vortex-file-compressed +6.0% -0.5% +6.5% +11.2% ➖ noise
55 duckdb:duckdb -3.6% -0.5% -3.1% +17.6% ➖ noise
55 duckdb:vortex-compact +3.2% -0.5% +3.8% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -3.5% -0.5% -3.0% +10.0% ➖ noise
56 datafusion:vortex-compact -2.6% +0.2% -2.8% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +1.1% +0.2% +0.9% +10.0% ➖ noise
56 duckdb:duckdb +0.9% +0.2% +0.7% +10.0% ➖ noise
56 duckdb:vortex-compact +2.0% +0.2% +1.8% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -2.6% +0.2% -2.8% +10.0% ➖ noise
57 datafusion:vortex-compact -6.2% +1.4% -7.5% +10.4% ➖ noise
57 datafusion:vortex-file-compressed -4.3% +1.4% -5.7% +10.0% ➖ noise
57 duckdb:duckdb +1.2% +1.4% -0.2% +10.0% ➖ noise
57 duckdb:vortex-compact -2.2% +1.4% -3.5% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -0.6% +1.4% -1.9% +10.0% ➖ noise
58 datafusion:vortex-compact -5.8% -0.4% -5.4% +10.7% ➖ noise
58 datafusion:vortex-file-compressed -5.2% -0.4% -4.8% +10.3% ➖ noise
58 duckdb:duckdb +4.9% -0.4% +5.3% +10.9% ➖ noise
58 duckdb:vortex-compact -2.4% -0.4% -2.1% +10.0% ➖ noise
58 duckdb:vortex-file-compressed +3.4% -0.4% +3.8% +11.7% ➖ noise
59 datafusion:vortex-compact -2.2% +0.2% -2.4% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +0.1% +0.2% -0.1% +10.0% ➖ noise
59 duckdb:duckdb -1.3% +0.2% -1.5% +11.2% ➖ noise
59 duckdb:vortex-compact -8.6% +0.2% -8.7% +11.0% ➖ noise
59 duckdb:vortex-file-compressed +0.9% +0.2% +0.7% +10.5% ➖ noise
60 datafusion:vortex-compact -5.0% -1.4% -3.6% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -1.5% -1.4% -0.1% +10.0% ➖ noise
60 duckdb:duckdb -2.4% -1.4% -1.0% +10.0% ➖ noise
60 duckdb:vortex-compact -0.3% -1.4% +1.1% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -3.6% -1.4% -2.2% +17.7% ➖ noise
61 datafusion:vortex-compact -1.1% +2.7% -3.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +1.3% +2.7% -1.3% +10.7% ➖ noise
61 duckdb:duckdb -0.2% +2.7% -2.8% +10.2% ➖ noise
61 duckdb:vortex-compact +1.2% +2.7% -1.4% +11.0% ➖ noise
61 duckdb:vortex-file-compressed -2.1% +2.7% -4.7% +12.3% ➖ noise
62 datafusion:vortex-compact +1.9% +0.1% +1.8% +39.2% ➖ noise
62 datafusion:vortex-file-compressed -12.0% +0.1% -12.0% +22.6% ➖ noise
62 duckdb:duckdb +1.2% +0.1% +1.1% +21.1% ➖ noise
62 duckdb:vortex-compact -10.6% +0.1% -10.7% +22.6% ➖ noise
62 duckdb:vortex-file-compressed +4.3% +0.1% +4.2% +17.2% ➖ noise
63 datafusion:vortex-compact +2.8% +1.0% +1.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -0.0% +1.0% -1.0% +10.0% ➖ noise
63 duckdb:duckdb +0.3% +1.0% -0.7% +10.0% ➖ noise
63 duckdb:vortex-compact +1.7% +1.0% +0.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -1.8% +1.0% -2.8% +10.0% ➖ noise
64 datafusion:vortex-compact -2.7% -2.1% -0.7% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -2.2% -2.1% -0.1% +10.0% ➖ noise
64 duckdb:duckdb +1.7% -2.1% +3.9% +10.0% ➖ noise
64 duckdb:vortex-compact +1.1% -2.1% +3.2% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +0.1% -2.1% +2.2% +10.0% ➖ noise
65 datafusion:vortex-compact +2.1% +1.2% +0.9% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +5.4% +1.2% +4.1% +19.8% ➖ noise
65 duckdb:duckdb -1.1% +1.2% -2.2% +10.0% ➖ noise
65 duckdb:vortex-compact +2.7% +1.2% +1.5% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -4.2% +1.2% -5.3% +12.0% ➖ noise
66 datafusion:vortex-compact +5.0% +8.2% -2.9% +10.9% ➖ noise
66 datafusion:vortex-file-compressed +1.3% +8.2% -6.3% +10.0% ➖ noise
66 duckdb:duckdb -0.9% +8.2% -8.4% +10.0% ➖ noise
66 duckdb:vortex-compact -4.1% +8.2% -11.3% +21.1% ➖ noise
66 duckdb:vortex-file-compressed -0.8% +8.2% -8.3% +10.0% ➖ noise
67 datafusion:vortex-compact -0.2% -0.1% -0.1% +11.8% ➖ noise
67 datafusion:vortex-file-compressed -5.8% -0.1% -5.7% +10.0% ➖ noise
67 duckdb:duckdb +2.3% -0.1% +2.5% +10.0% ➖ noise
67 duckdb:vortex-compact -0.5% -0.1% -0.4% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -2.3% -0.1% -2.2% +10.0% ➖ noise
68 datafusion:vortex-compact +0.9% -0.9% +1.9% +19.4% ➖ noise
68 datafusion:vortex-file-compressed +1.0% -0.9% +1.9% +10.0% ➖ noise
68 duckdb:duckdb -4.4% -0.9% -3.5% +10.0% ➖ noise
68 duckdb:vortex-compact -7.9% -0.9% -7.0% +15.5% ➖ noise
68 duckdb:vortex-file-compressed +0.2% -0.9% +1.1% +11.1% ➖ noise
69 datafusion:vortex-compact -0.6% +0.5% -1.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +0.3% +0.5% -0.3% +10.0% ➖ noise
69 duckdb:duckdb +0.2% +0.5% -0.4% +11.3% ➖ noise
69 duckdb:vortex-compact -0.2% +0.5% -0.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -2.2% +0.5% -2.7% +10.0% ➖ noise
70 datafusion:vortex-compact +0.4% -0.1% +0.5% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -3.7% -0.1% -3.5% +10.5% ➖ noise
70 duckdb:duckdb +3.4% -0.1% +3.5% +10.0% ➖ noise
70 duckdb:vortex-compact -1.7% -0.1% -1.6% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +7.4% -0.1% +7.6% +12.5% ➖ noise
71 datafusion:vortex-compact +4.0% +1.9% +2.1% +19.5% ➖ noise
71 datafusion:vortex-file-compressed -3.7% +1.9% -5.4% +10.0% ➖ noise
71 duckdb:duckdb -3.2% +1.9% -5.0% +10.4% ➖ noise
71 duckdb:vortex-compact +1.1% +1.9% -0.7% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +13.7% +1.9% +11.6% +19.2% ➖ noise
72 datafusion:vortex-compact -0.1% +0.8% -0.9% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -1.2% +0.8% -2.0% +10.0% ➖ noise
72 duckdb:duckdb +2.4% +0.8% +1.6% +10.0% ➖ noise
72 duckdb:vortex-compact +1.0% +0.8% +0.2% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.1% +0.8% -2.9% +10.0% ➖ noise
73 datafusion:vortex-compact -0.6% +7.6% -7.5% +10.0% ➖ noise
73 datafusion:vortex-file-compressed -1.1% +7.6% -8.0% +10.0% ➖ noise
73 duckdb:duckdb +4.0% +7.6% -3.3% +13.1% ➖ noise
73 duckdb:vortex-compact +1.3% +7.6% -5.9% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +0.7% +7.6% -6.4% +10.0% ➖ noise
74 datafusion:vortex-compact +7.3% +0.9% +6.4% +14.2% ➖ noise
74 datafusion:vortex-file-compressed -6.5% +0.9% -7.3% +12.5% ➖ noise
74 duckdb:duckdb +0.6% +0.9% -0.3% +10.0% ➖ noise
74 duckdb:vortex-compact +2.2% +0.9% +1.3% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -3.3% +0.9% -4.2% +10.0% ➖ noise
75 datafusion:vortex-compact -0.4% +0.2% -0.6% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -2.6% +0.2% -2.7% +10.9% ➖ noise
75 duckdb:duckdb +2.5% +0.2% +2.4% +10.0% ➖ noise
75 duckdb:vortex-compact -0.3% +0.2% -0.5% +10.5% ➖ noise
75 duckdb:vortex-file-compressed +6.9% +0.2% +6.7% +11.4% ➖ noise
76 datafusion:vortex-compact -1.2% +0.2% -1.4% +19.0% ➖ noise
76 datafusion:vortex-file-compressed +1.8% +0.2% +1.6% +10.0% ➖ noise
76 duckdb:duckdb +0.2% +0.2% -0.0% +10.0% ➖ noise
76 duckdb:vortex-compact -1.6% +0.2% -1.8% +14.7% ➖ noise
76 duckdb:vortex-file-compressed -5.8% +0.2% -6.0% +16.8% ➖ noise
77 datafusion:vortex-compact +0.0% +0.4% -0.4% +11.8% ➖ noise
77 datafusion:vortex-file-compressed +2.3% +0.4% +1.9% +14.7% ➖ noise
77 duckdb:duckdb +3.8% +0.4% +3.3% +11.1% ➖ noise
77 duckdb:vortex-compact +1.0% +0.4% +0.5% +12.1% ➖ noise
77 duckdb:vortex-file-compressed +1.9% +0.4% +1.5% +11.6% ➖ noise
78 datafusion:vortex-compact -1.1% -0.7% -0.4% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -3.8% -0.7% -3.1% +10.0% ➖ noise
78 duckdb:duckdb +0.5% -0.7% +1.3% +10.0% ➖ noise
78 duckdb:vortex-compact -1.3% -0.7% -0.6% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +5.2% -0.7% +6.0% +10.9% ➖ noise
79 datafusion:vortex-compact +0.3% +2.2% -1.9% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -0.3% +2.2% -2.4% +12.5% ➖ noise
79 duckdb:duckdb -3.0% +2.2% -5.0% +10.0% ➖ noise
79 duckdb:vortex-compact +3.8% +2.2% +1.6% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -2.5% +2.2% -4.6% +10.9% ➖ noise
80 datafusion:vortex-compact -2.2% +3.9% -5.9% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -3.7% +3.9% -7.3% +10.0% ➖ noise
80 duckdb:duckdb -12.3% +3.9% -15.5% +11.1% ✅ faster
80 duckdb:vortex-compact -1.3% +3.9% -5.0% +12.1% ➖ noise
80 duckdb:vortex-file-compressed -0.1% +3.9% -3.8% +10.1% ➖ noise
81 datafusion:vortex-compact +1.2% +0.4% +0.7% +15.8% ➖ noise
81 datafusion:vortex-file-compressed -10.0% +0.4% -10.4% +10.2% ✅ faster
81 duckdb:duckdb +4.3% +0.4% +3.8% +10.0% ➖ noise
81 duckdb:vortex-compact +3.3% +0.4% +2.9% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -0.3% +0.4% -0.7% +10.0% ➖ noise
82 datafusion:vortex-compact -1.8% -1.4% -0.4% +15.9% ➖ noise
82 datafusion:vortex-file-compressed -0.2% -1.4% +1.3% +21.6% ➖ noise
82 duckdb:duckdb +3.2% -1.4% +4.7% +10.7% ➖ noise
82 duckdb:vortex-compact -1.6% -1.4% -0.1% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -1.7% -1.4% -0.3% +10.0% ➖ noise
83 datafusion:vortex-compact -3.8% +0.2% -4.0% +11.6% ➖ noise
83 datafusion:vortex-file-compressed -2.0% +0.2% -2.2% +10.0% ➖ noise
83 duckdb:duckdb +3.3% +0.2% +3.1% +10.0% ➖ noise
83 duckdb:vortex-compact -2.0% +0.2% -2.2% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -3.8% +0.2% -4.0% +10.0% ➖ noise
84 datafusion:vortex-compact -6.6% -0.6% -6.1% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -3.9% -0.6% -3.3% +10.0% ➖ noise
84 duckdb:duckdb -3.1% -0.6% -2.6% +10.0% ➖ noise
84 duckdb:vortex-compact -4.2% -0.6% -3.6% +13.0% ➖ noise
84 duckdb:vortex-file-compressed -1.0% -0.6% -0.4% +10.0% ➖ noise
85 datafusion:vortex-compact -5.0% +0.9% -5.9% +16.9% ➖ noise
85 datafusion:vortex-file-compressed -0.7% +0.9% -1.6% +10.0% ➖ noise
85 duckdb:duckdb +2.4% +0.9% +1.5% +10.0% ➖ noise
85 duckdb:vortex-compact -2.7% +0.9% -3.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -0.2% +0.9% -1.1% +10.0% ➖ noise
86 datafusion:vortex-compact -13.9% +1.3% -15.0% +27.6% ➖ noise
86 datafusion:vortex-file-compressed -14.1% +1.3% -15.1% +17.8% ✅ faster
86 duckdb:duckdb -4.1% +1.3% -5.3% +10.0% ➖ noise
86 duckdb:vortex-compact +2.0% +1.3% +0.8% +17.1% ➖ noise
86 duckdb:vortex-file-compressed -3.7% +1.3% -4.9% +22.6% ➖ noise
87 datafusion:vortex-compact +0.8% -0.2% +1.0% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +1.0% -0.2% +1.2% +10.0% ➖ noise
87 duckdb:duckdb +1.0% -0.2% +1.2% +10.0% ➖ noise
87 duckdb:vortex-compact -4.8% -0.2% -4.6% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -1.2% -0.2% -0.9% +11.1% ➖ noise
88 datafusion:vortex-compact -8.0% -1.0% -7.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.5% -1.0% +1.5% +10.0% ➖ noise
88 duckdb:duckdb +3.1% -1.0% +4.1% +10.0% ➖ noise
88 duckdb:vortex-compact +2.6% -1.0% +3.6% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +1.8% -1.0% +2.8% +10.0% ➖ noise
89 datafusion:vortex-compact -2.2% -0.1% -2.1% +20.7% ➖ noise
89 datafusion:vortex-file-compressed -1.3% -0.1% -1.2% +21.6% ➖ noise
89 duckdb:duckdb +0.4% -0.1% +0.4% +10.0% ➖ noise
89 duckdb:vortex-compact +1.0% -0.1% +1.1% +18.6% ➖ noise
89 duckdb:vortex-file-compressed -0.1% -0.1% -0.1% +10.0% ➖ noise
90 datafusion:vortex-compact +1.9% +3.9% -1.9% +10.9% ➖ noise
90 datafusion:vortex-file-compressed -1.1% +3.9% -4.8% +11.1% ➖ noise
90 duckdb:duckdb -4.1% +3.9% -7.7% +15.1% ➖ noise
90 duckdb:vortex-compact +0.2% +3.9% -3.6% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -0.9% +3.9% -4.7% +25.3% ➖ noise
91 datafusion:vortex-compact +0.0% +2.2% -2.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -0.5% +2.2% -2.6% +10.0% ➖ noise
91 duckdb:duckdb +2.3% +2.2% +0.1% +10.0% ➖ noise
91 duckdb:vortex-compact -4.3% +2.2% -6.4% +10.6% ➖ noise
91 duckdb:vortex-file-compressed +0.5% +2.2% -1.7% +10.0% ➖ noise
92 datafusion:vortex-compact -7.0% -0.2% -6.9% +13.9% ➖ noise
92 datafusion:vortex-file-compressed -5.8% -0.2% -5.6% +10.0% ➖ noise
92 duckdb:duckdb +0.8% -0.2% +0.9% +12.1% ➖ noise
92 duckdb:vortex-compact -8.4% -0.2% -8.3% +20.8% ➖ noise
92 duckdb:vortex-file-compressed +6.5% -0.2% +6.7% +14.3% ➖ noise
93 datafusion:vortex-compact -4.0% -1.0% -2.9% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -0.8% -1.0% +0.2% +12.7% ➖ noise
93 duckdb:duckdb -1.0% -1.0% -0.0% +10.0% ➖ noise
93 duckdb:vortex-compact +2.6% -1.0% +3.7% +10.0% ➖ noise
93 duckdb:vortex-file-compressed -1.4% -1.0% -0.3% +10.0% ➖ noise
94 datafusion:vortex-compact -5.1% -0.8% -4.3% +18.5% ➖ noise
94 datafusion:vortex-file-compressed +2.0% -0.8% +2.8% +10.0% ➖ noise
94 duckdb:duckdb -8.0% -0.8% -7.3% +25.6% ➖ noise
94 duckdb:vortex-compact +4.9% -0.8% +5.7% +11.3% ➖ noise
94 duckdb:vortex-file-compressed -1.0% -0.8% -0.1% +10.0% ➖ noise
95 datafusion:vortex-compact -3.4% +8.3% -10.8% +10.0% ✅ faster
95 datafusion:vortex-file-compressed -2.4% +8.3% -9.9% +10.0% ✅ faster
95 duckdb:duckdb -10.7% +8.3% -17.5% +13.6% ✅ faster
95 duckdb:vortex-compact -0.5% +8.3% -8.1% +10.2% ➖ noise
95 duckdb:vortex-file-compressed -12.0% +8.3% -18.7% +22.7% ✅ faster
96 datafusion:vortex-compact +0.1% +5.0% -4.7% +13.5% ➖ noise
96 datafusion:vortex-file-compressed +6.1% +5.0% +1.1% +13.1% ➖ noise
96 duckdb:duckdb -0.8% +5.0% -5.5% +16.3% ➖ noise
96 duckdb:vortex-compact -7.1% +5.0% -11.5% +12.2% ✅ faster
96 duckdb:vortex-file-compressed +3.5% +5.0% -1.4% +10.2% ➖ noise
97 datafusion:vortex-compact +0.4% -2.0% +2.4% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +1.3% -2.0% +3.3% +10.0% ➖ noise
97 duckdb:duckdb -0.7% -2.0% +1.3% +10.0% ➖ noise
97 duckdb:vortex-compact +5.9% -2.0% +8.0% +11.9% ➖ noise
97 duckdb:vortex-file-compressed +3.2% -2.0% +5.3% +11.8% ➖ noise
98 datafusion:vortex-compact -2.9% +0.5% -3.4% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -1.3% +0.5% -1.8% +10.0% ➖ noise
98 duckdb:duckdb +3.1% +0.5% +2.6% +10.0% ➖ noise
98 duckdb:vortex-compact -0.3% +0.5% -0.8% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -1.1% +0.5% -1.6% +10.0% ➖ noise
99 datafusion:vortex-compact +1.1% -0.9% +2.1% +18.9% ➖ noise
99 datafusion:vortex-file-compressed -2.1% -0.9% -1.2% +24.9% ➖ noise
99 duckdb:duckdb -0.3% -0.9% +0.7% +10.0% ➖ noise
99 duckdb:vortex-compact -0.9% -0.9% +0.1% +13.2% ➖ noise
99 duckdb:vortex-file-compressed +0.8% -0.9% +1.8% +14.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (48 files changed, -0.0% overall, 0↑ 48↓)
File Scale Format Base HEAD Change %
store_sales.vortex 1.0 vortex-file-compressed 97.04 MB 97.04 MB 32 B -0.0%
store_sales.vortex 1.0 vortex-compact 77.87 MB 77.87 MB 32 B -0.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.78 MB 70.78 MB 32 B -0.0%
catalog_sales.vortex 1.0 vortex-compact 59.31 MB 59.31 MB 32 B -0.0%
inventory.vortex 1.0 vortex-file-compressed 36.64 MB 36.64 MB 32 B -0.0%
web_sales.vortex 1.0 vortex-file-compressed 34.27 MB 34.27 MB 32 B -0.0%
web_sales.vortex 1.0 vortex-compact 29.35 MB 29.35 MB 32 B -0.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 16.07 MB 32 B -0.0%
store_returns.vortex 1.0 vortex-file-compressed 11.39 MB 11.39 MB 32 B -0.0%
store_returns.vortex 1.0 vortex-compact 9.31 MB 9.31 MB 32 B -0.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.43 MB 7.43 MB 32 B -0.0%
catalog_returns.vortex 1.0 vortex-compact 6.02 MB 6.02 MB 32 B -0.0%
customer.vortex 1.0 vortex-file-compressed 4.52 MB 4.52 MB 32 B -0.0%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 3.55 MB 32 B -0.0%
customer.vortex 1.0 vortex-compact 3.29 MB 3.29 MB 32 B -0.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 2.99 MB 32 B -0.0%
item.vortex 1.0 vortex-file-compressed 1.75 MB 1.75 MB 32 B -0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 1.49 MB 32 B -0.0%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 1.03 MB 32 B -0.0%
customer_address.vortex 1.0 vortex-file-compressed 1012.96 KB 1012.93 KB 32 B -0.0%
item.vortex 1.0 vortex-compact 994.21 KB 994.18 KB 32 B -0.0%
time_dim.vortex 1.0 vortex-file-compressed 687.30 KB 687.27 KB 32 B -0.0%
customer_demographics.vortex 1.0 vortex-compact 649.61 KB 649.58 KB 32 B -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 611.57 KB 611.54 KB 32 B -0.0%
customer_address.vortex 1.0 vortex-compact 558.62 KB 558.59 KB 32 B -0.0%
catalog_page.vortex 1.0 vortex-compact 362.67 KB 362.64 KB 32 B -0.0%
date_dim.vortex 1.0 vortex-compact 154.00 KB 153.96 KB 32 B -0.0%
time_dim.vortex 1.0 vortex-compact 97.35 KB 97.32 KB 32 B -0.0%
promotion.vortex 1.0 vortex-file-compressed 60.19 KB 60.16 KB 32 B -0.1%
call_center.vortex 1.0 vortex-file-compressed 54.94 KB 54.91 KB 32 B -0.1%
web_site.vortex 1.0 vortex-file-compressed 54.08 KB 54.05 KB 32 B -0.1%
promotion.vortex 1.0 vortex-compact 51.51 KB 51.48 KB 32 B -0.1%
call_center.vortex 1.0 vortex-compact 50.14 KB 50.11 KB 32 B -0.1%
store.vortex 1.0 vortex-file-compressed 49.49 KB 49.46 KB 32 B -0.1%
store.vortex 1.0 vortex-compact 45.76 KB 45.73 KB 32 B -0.1%
web_site.vortex 1.0 vortex-compact 45.31 KB 45.28 KB 32 B -0.1%
web_page.vortex 1.0 vortex-file-compressed 31.92 KB 31.89 KB 32 B -0.1%
web_page.vortex 1.0 vortex-compact 27.84 KB 27.80 KB 32 B -0.1%
warehouse.vortex 1.0 vortex-file-compressed 23.83 KB 23.80 KB 32 B -0.1%
warehouse.vortex 1.0 vortex-compact 22.23 KB 22.20 KB 32 B -0.1%
household_demographics.vortex 1.0 vortex-file-compressed 17.05 KB 17.02 KB 32 B -0.2%
ship_mode.vortex 1.0 vortex-file-compressed 13.12 KB 13.09 KB 32 B -0.2%
ship_mode.vortex 1.0 vortex-compact 10.95 KB 10.92 KB 32 B -0.3%
household_demographics.vortex 1.0 vortex-compact 10.79 KB 10.76 KB 32 B -0.3%
reason.vortex 1.0 vortex-file-compressed 7.23 KB 7.20 KB 32 B -0.4%
income_band.vortex 1.0 vortex-file-compressed 6.19 KB 6.16 KB 32 B -0.5%
income_band.vortex 1.0 vortex-compact 5.98 KB 5.95 KB 32 B -0.5%
reason.vortex 1.0 vortex-compact 5.97 KB 5.94 KB 32 B -0.5%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 272.70 MB → 272.70 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 1.015x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -2.0%


datafusion / vortex-file-compressed (1.084x ➖, 0↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 42543495 36376165 1.17
fineweb_q01/datafusion:vortex-file-compressed 728518507 813632508 0.90
fineweb_q02/datafusion:vortex-file-compressed 🚨 1080702701 640690863 1.69
fineweb_q03/datafusion:vortex-file-compressed 1441727626 1372122172 1.05
fineweb_q04/datafusion:vortex-file-compressed 1359912553 1361196821 1.00
fineweb_q05/datafusion:vortex-file-compressed 1347143041 1335374730 1.01
fineweb_q06/datafusion:vortex-file-compressed 1631934771 1563328895 1.04
fineweb_q07/datafusion:vortex-file-compressed 1416952728 1337146720 1.06
fineweb_q08/datafusion:vortex-file-compressed 512395589 513944962 1.00
datafusion / vortex-compact (0.985x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 31841416 35552507 0.90
fineweb_q01/datafusion:vortex-compact 781253380 632770662 1.23
fineweb_q02/datafusion:vortex-compact 652238267 638892473 1.02
fineweb_q03/datafusion:vortex-compact 1383064650 1415671215 0.98
fineweb_q04/datafusion:vortex-compact 1532313061 1727461086 0.89
fineweb_q05/datafusion:vortex-compact 1356558634 1363846701 0.99
fineweb_q06/datafusion:vortex-compact 1335732758 1345221455 0.99
fineweb_q07/datafusion:vortex-compact 1187951109 1197285004 0.99
fineweb_q08/datafusion:vortex-compact 369912030 408007860 0.91
datafusion / parquet (1.009x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1074451068 1277324016 0.84
fineweb_q01/datafusion:parquet 1945184151 1978398559 0.98
fineweb_q02/datafusion:parquet 2092982585 1917646888 1.09
fineweb_q03/datafusion:parquet 1928121844 1923719328 1.00
fineweb_q04/datafusion:parquet 2048047519 1902045555 1.08
fineweb_q05/datafusion:parquet 2151043016 2418785368 0.89
fineweb_q06/datafusion:parquet 2456039146 2260900107 1.09
fineweb_q07/datafusion:parquet 2172582057 2084218718 1.04
fineweb_q08/datafusion:parquet 2031531345 1842325899 1.10
duckdb / vortex-file-compressed (1.007x ➖, 0↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 87256324 107572649 0.81
fineweb_q01/duckdb:vortex-file-compressed 638723678 568687888 1.12
fineweb_q02/duckdb:vortex-file-compressed 🚨 634646107 469801139 1.35
fineweb_q03/duckdb:vortex-file-compressed 1617379358 1690477243 0.96
fineweb_q04/duckdb:vortex-file-compressed 1605226487 1785564781 0.90
fineweb_q05/duckdb:vortex-file-compressed 1528364564 1602603438 0.95
fineweb_q06/duckdb:vortex-file-compressed 1651008468 1680537597 0.98
fineweb_q07/duckdb:vortex-file-compressed 1488652963 1461753019 1.02
fineweb_q08/duckdb:vortex-file-compressed 639925027 609612941 1.05
duckdb / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 104210592 84115173 1.24
fineweb_q01/duckdb:vortex-compact 549861517 562375510 0.98
fineweb_q02/duckdb:vortex-compact 567290470 601386104 0.94
fineweb_q03/duckdb:vortex-compact 1629154125 1631306235 1.00
fineweb_q04/duckdb:vortex-compact 1708724168 2026804179 0.84
fineweb_q05/duckdb:vortex-compact 1638137873 1592731086 1.03
fineweb_q06/duckdb:vortex-compact 1527862803 1586400920 0.96
fineweb_q07/duckdb:vortex-compact 1384283796 1450001805 0.95
fineweb_q08/duckdb:vortex-compact 485892151 485165817 1.00
duckdb / parquet (0.988x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1125654336 1079495060 1.04
fineweb_q01/duckdb:parquet 1451560938 1399000616 1.04
fineweb_q02/duckdb:parquet 1453957197 1390970478 1.05
fineweb_q03/duckdb:parquet 3660612767 3863147340 0.95
fineweb_q04/duckdb:parquet 1853786448 2052913099 0.90
fineweb_q05/duckdb:parquet 2165767184 2189565598 0.99
fineweb_q06/duckdb:parquet 4358539523 4609166274 0.95
fineweb_q07/duckdb:parquet 2721826577 2758505429 0.99
fineweb_q08/duckdb:parquet 1133620433 1125970363 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -10.4% -6.3% -4.4% +152.9% ➖ noise
0 datafusion:vortex-file-compressed +17.0% -6.3% +24.9% +161.7% ➖ noise
0 duckdb:vortex-compact +23.9% -6.3% +32.3% +55.1% ➖ noise
0 duckdb:vortex-file-compressed -18.9% -6.3% -13.4% +66.7% ➖ noise
1 datafusion:vortex-compact +23.5% +1.0% +22.2% +43.4% ➖ noise
1 datafusion:vortex-file-compressed -10.5% +1.0% -11.3% +58.7% ➖ noise
1 duckdb:vortex-compact -2.2% +1.0% -3.2% +31.7% ➖ noise
1 duckdb:vortex-file-compressed +12.3% +1.0% +11.2% +38.5% ➖ noise
2 datafusion:vortex-compact +2.1% +6.8% -4.4% +54.6% ➖ noise
2 datafusion:vortex-file-compressed +68.7% +6.8% +57.9% +81.6% ➖ noise
2 duckdb:vortex-compact -5.7% +6.8% -11.7% +31.5% ➖ noise
2 duckdb:vortex-file-compressed +35.1% +6.8% +26.5% +30.0% ➖ noise
3 datafusion:vortex-compact -2.3% -2.5% +0.2% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +5.1% -2.5% +7.8% +30.0% ➖ noise
3 duckdb:vortex-compact -0.1% -2.5% +2.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -4.3% -2.5% -1.8% +30.0% ➖ noise
4 datafusion:vortex-compact -11.3% -1.4% -10.0% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% -1.4% +1.3% +30.0% ➖ noise
4 duckdb:vortex-compact -15.7% -1.4% -14.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -10.1% -1.4% -8.8% +30.0% ➖ noise
5 datafusion:vortex-compact -0.5% -6.2% +6.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.9% -6.2% +7.6% +30.0% ➖ noise
5 duckdb:vortex-compact +2.9% -6.2% +9.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -4.6% -6.2% +1.7% +30.0% ➖ noise
6 datafusion:vortex-compact -0.7% +1.4% -2.0% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +4.4% +1.4% +3.0% +30.0% ➖ noise
6 duckdb:vortex-compact -3.7% +1.4% -5.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -1.8% +1.4% -3.1% +30.0% ➖ noise
7 datafusion:vortex-compact -0.8% +1.4% -2.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +6.0% +1.4% +4.5% +30.0% ➖ noise
7 duckdb:vortex-compact -4.5% +1.4% -5.9% +37.3% ➖ noise
7 duckdb:vortex-file-compressed +1.8% +1.4% +0.4% +30.0% ➖ noise
8 datafusion:vortex-compact -9.3% +5.4% -14.0% +56.7% ➖ noise
8 datafusion:vortex-file-compressed -0.3% +5.4% -5.4% +30.0% ➖ noise
8 duckdb:vortex-compact +0.1% +5.4% -5.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +5.0% +5.4% -0.4% +40.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.6%


duckdb / vortex-file-compressed (0.995x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11924307 11844033 1.01
statpopgen_q01/duckdb:vortex-file-compressed 27375481 27851882 0.98
statpopgen_q02/duckdb:vortex-file-compressed 540407485 535954210 1.01
statpopgen_q03/duckdb:vortex-file-compressed 1054364320 1040380538 1.01
statpopgen_q04/duckdb:vortex-file-compressed 1057046363 1055432626 1.00
statpopgen_q05/duckdb:vortex-file-compressed 473317111 492226655 0.96
statpopgen_q06/duckdb:vortex-file-compressed 1543892559 1538490031 1.00
statpopgen_q07/duckdb:vortex-file-compressed 203992461 206765694 0.99
statpopgen_q08/duckdb:vortex-file-compressed 241644605 239908387 1.01
statpopgen_q09/duckdb:vortex-file-compressed 842554889 858761861 0.98
statpopgen_q10/duckdb:vortex-file-compressed 2554587779 2570779154 0.99
duckdb / vortex-compact (1.010x ➖, 0↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11661995 11677550 1.00
statpopgen_q01/duckdb:vortex-compact 🚨 244143272 214416481 1.14
statpopgen_q02/duckdb:vortex-compact 554237595 556449972 1.00
statpopgen_q03/duckdb:vortex-compact 1152727276 1144968700 1.01
statpopgen_q04/duckdb:vortex-compact 1151221634 1169394794 0.98
statpopgen_q05/duckdb:vortex-compact 572990961 576920286 0.99
statpopgen_q06/duckdb:vortex-compact 1515472198 1500590329 1.01
statpopgen_q07/duckdb:vortex-compact 886077989 889845991 1.00
statpopgen_q08/duckdb:vortex-compact 913589592 923126450 0.99
statpopgen_q09/duckdb:vortex-compact 934736224 923489630 1.01
statpopgen_q10/duckdb:vortex-compact 2585370130 2605634398 0.99
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 292525415 304242712 0.96
statpopgen_q01/duckdb:parquet 374947706 381408625 0.98
statpopgen_q02/duckdb:parquet 757877374 755910995 1.00
statpopgen_q03/duckdb:parquet 1181080336 1205477243 0.98
statpopgen_q04/duckdb:parquet 1183977730 1178968019 1.00
statpopgen_q05/duckdb:parquet 808696235 812679037 1.00
statpopgen_q06/duckdb:parquet 1430044780 1424761425 1.00
statpopgen_q07/duckdb:parquet 851256069 857210680 0.99
statpopgen_q08/duckdb:parquet 833708975 854778210 0.98
statpopgen_q09/duckdb:parquet 998339558 1009481109 0.99
statpopgen_q10/duckdb:parquet 2221616079 2209512713 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.1% -3.9% +3.9% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +0.7% -3.9% +4.7% +10.6% ➖ noise
1 duckdb:vortex-compact +13.9% -1.7% +15.8% +13.7% 🚨 regression
1 duckdb:vortex-file-compressed -1.7% -1.7% -0.0% +219.6% ➖ noise
2 duckdb:vortex-compact -0.4% +0.3% -0.7% +10.7% ➖ noise
2 duckdb:vortex-file-compressed +0.8% +0.3% +0.6% +10.0% ➖ noise
3 duckdb:vortex-compact +0.7% -2.0% +2.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.3% -2.0% +3.4% +10.0% ➖ noise
4 duckdb:vortex-compact -1.6% +0.4% -2.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.2% +0.4% -0.3% +10.0% ➖ noise
5 duckdb:vortex-compact -0.7% -0.5% -0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.8% -0.5% -3.4% +10.9% ➖ noise
6 duckdb:vortex-compact +1.0% +0.4% +0.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.4% +0.4% -0.0% +10.0% ➖ noise
7 duckdb:vortex-compact -0.4% -0.7% +0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.3% -0.7% -0.7% +10.0% ➖ noise
8 duckdb:vortex-compact -1.0% -2.5% +1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.7% -2.5% +3.3% +10.0% ➖ noise
9 duckdb:vortex-compact +1.2% -1.1% +2.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.9% -1.1% -0.8% +10.0% ➖ noise
10 duckdb:vortex-compact -0.8% +0.5% -1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.6% +0.5% -1.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, -0.0% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.97 GB 1.97 GB 32 B -0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 959.35 MB 959.35 MB 32 B -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (-0.0%)
  • vortex-file-compressed: 1.97 GB → 1.97 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.847x ✅
Parquet (geomean): 0.922x ➖


unknown / unknown (0.882x ✅, 19↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 382143 2029593 0.19
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1091349 1086843 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8387630205 9044063053 0.93
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8274255944 8882108647 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7709383 8514557 0.91
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 7142807 8306262 0.86
random-access/feature-vectors/uniform/lance-tokio-local-disk 1225193 1246016 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1871716 1963628 0.95
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8397423628 8855960301 0.95
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 9139152454 8725061169 1.05
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12919323 14838786 0.87
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12985784 14815940 0.88
random-access/lance-tokio-local-disk 645774 674048 0.96
random-access/lance-tokio-local-disk-footer 1309872 1383830 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk 243467 249560 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 624416 618407 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk 130422692 138528051 0.94
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 137313248 139672630 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 567122 724989 0.78
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 600292 727043 0.83
random-access/nested-lists/uniform/lance-tokio-local-disk 1077850 1052744 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1380343 1468786 0.94
random-access/nested-lists/uniform/parquet-tokio-local-disk 140451829 138441408 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 129233932 139245573 0.93
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 2130227 2456080 0.87
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2116960 2481728 0.85
random-access/nested-structs/correlated/lance-tokio-local-disk 370422 386849 0.96
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 545312 586383 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 20811744 25308132 0.82
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚀 20733563 25257228 0.82
random-access/nested-structs/correlated/vortex-tokio-local-disk 758260 820449 0.92
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 734140 884654 0.83
random-access/nested-structs/uniform/lance-tokio-local-disk 2524483 2726984 0.93
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2715975 2948351 0.92
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚀 21161473 25426784 0.83
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 21096593 25342878 0.83
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1560582 1865133 0.84
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1570278 1957365 0.80
random-access/parquet-tokio-local-disk 165298037 177596621 0.93
random-access/parquet-tokio-local-disk-footer 165431422 177277093 0.93
random-access/taxi/correlated/lance-tokio-local-disk 942956 988279 0.95
random-access/taxi/correlated/lance-tokio-local-disk-footer 2039856 2046025 1.00
random-access/taxi/correlated/parquet-tokio-local-disk 247458887 265618058 0.93
random-access/taxi/correlated/parquet-tokio-local-disk-footer 250139491 267747352 0.93
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1524292 2147725 0.71
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1675700 2171890 0.77
random-access/taxi/uniform/lance-tokio-local-disk 9921287 10124790 0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer 10113152 10802149 0.94
random-access/taxi/uniform/parquet-tokio-local-disk 264334542 283087252 0.93
random-access/taxi/uniform/parquet-tokio-local-disk-footer 265811514 285290280 0.93
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4437759 5230093 0.85
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4423348 5221249 0.85
random-access/vortex-tokio-local-disk 1335549 1398205 0.96
random-access/vortex-tokio-local-disk-footer 1337234 1470569 0.91

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Vortex (geomean): 1.019x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -2.3%


datafusion / vortex-file-compressed (1.047x ➖, 0↑ 7↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 399789105 399224379 1.00
tpch_q02/datafusion:vortex-file-compressed 106587073 111166705 0.96
tpch_q03/datafusion:vortex-file-compressed 213609310 222104738 0.96
tpch_q04/datafusion:vortex-file-compressed 115209356 115743731 1.00
tpch_q05/datafusion:vortex-file-compressed 🚨 475457708 382265086 1.24
tpch_q06/datafusion:vortex-file-compressed 🚨 45511015 37096547 1.23
tpch_q07/datafusion:vortex-file-compressed 🚨 658885878 514699473 1.28
tpch_q08/datafusion:vortex-file-compressed 353377312 363796655 0.97
tpch_q09/datafusion:vortex-file-compressed 628382864 656989545 0.96
tpch_q10/datafusion:vortex-file-compressed 227904584 236639972 0.96
tpch_q11/datafusion:vortex-file-compressed 81367651 83677643 0.97
tpch_q12/datafusion:vortex-file-compressed 116794415 121455201 0.96
tpch_q13/datafusion:vortex-file-compressed 213064472 220920076 0.96
tpch_q14/datafusion:vortex-file-compressed 51714887 53734845 0.96
tpch_q15/datafusion:vortex-file-compressed 98338476 101475677 0.97
tpch_q16/datafusion:vortex-file-compressed 75917425 77275593 0.98
tpch_q17/datafusion:vortex-file-compressed 642637023 654438392 0.98
tpch_q18/datafusion:vortex-file-compressed 865018143 876213958 0.99
tpch_q19/datafusion:vortex-file-compressed 🚨 82648966 69974327 1.18
tpch_q20/datafusion:vortex-file-compressed 🚨 208073618 168125508 1.24
tpch_q21/datafusion:vortex-file-compressed 🚨 874989860 678375385 1.29
tpch_q22/datafusion:vortex-file-compressed 🚨 74718162 65875480 1.13
datafusion / vortex-compact (1.056x ➖, 0↑ 8↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 538781691 437669118 1.23
tpch_q02/datafusion:vortex-compact 🚨 137636023 111226137 1.24
tpch_q03/datafusion:vortex-compact 🚨 282565370 221239411 1.28
tpch_q04/datafusion:vortex-compact 🚨 149889443 125121952 1.20
tpch_q05/datafusion:vortex-compact 369483036 385133296 0.96
tpch_q06/datafusion:vortex-compact 58701852 59750956 0.98
tpch_q07/datafusion:vortex-compact 517771672 531297108 0.97
tpch_q08/datafusion:vortex-compact 357618883 374134845 0.96
tpch_q09/datafusion:vortex-compact 638398329 663250917 0.96
tpch_q10/datafusion:vortex-compact 243057729 249842998 0.97
tpch_q11/datafusion:vortex-compact 82242648 84335071 0.98
tpch_q12/datafusion:vortex-compact 159269953 162429485 0.98
tpch_q13/datafusion:vortex-compact 264129663 271606332 0.97
tpch_q14/datafusion:vortex-compact 71023925 71559095 0.99
tpch_q15/datafusion:vortex-compact 153420011 156415416 0.98
tpch_q16/datafusion:vortex-compact 80703422 81283804 0.99
tpch_q17/datafusion:vortex-compact 641884709 657044420 0.98
tpch_q18/datafusion:vortex-compact 844266230 865192064 0.98
tpch_q19/datafusion:vortex-compact 🚨 137623561 124489029 1.11
tpch_q20/datafusion:vortex-compact 🚨 234760539 190229636 1.23
tpch_q21/datafusion:vortex-compact 🚨 866580085 676111144 1.28
tpch_q22/datafusion:vortex-compact 🚨 85604455 73624552 1.16
datafusion / parquet (0.994x ➖, 0↑ 3↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 447580156 468767127 0.95
tpch_q02/datafusion:parquet 173847527 174888556 0.99
tpch_q03/datafusion:parquet 282390674 289706337 0.97
tpch_q04/datafusion:parquet 126137464 132250173 0.95
tpch_q05/datafusion:parquet 431306698 452034065 0.95
tpch_q06/datafusion:parquet 🚨 142011730 125328714 1.13
tpch_q07/datafusion:parquet 🚨 773956136 619862436 1.25
tpch_q08/datafusion:parquet 🚨 567990327 475687978 1.19
tpch_q09/datafusion:parquet 735001492 757459822 0.97
tpch_q10/datafusion:parquet 496940083 504158281 0.99
tpch_q11/datafusion:parquet 115373480 120818019 0.95
tpch_q12/datafusion:parquet 192938188 197260702 0.98
tpch_q13/datafusion:parquet 327401383 335456369 0.98
tpch_q14/datafusion:parquet 152855729 158992771 0.96
tpch_q15/datafusion:parquet 238027599 255985540 0.93
tpch_q16/datafusion:parquet 123222201 125836377 0.98
tpch_q17/datafusion:parquet 668963070 700109601 0.96
tpch_q18/datafusion:parquet 872832254 916837281 0.95
tpch_q19/datafusion:parquet 251985225 256414042 0.98
tpch_q20/datafusion:parquet 282222410 296536123 0.95
tpch_q21/datafusion:parquet 689682549 715936577 0.96
tpch_q22/datafusion:parquet 216794914 218699145 0.99
datafusion / arrow (0.979x ➖, 1↑ 3↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 588800899 609311537 0.97
tpch_q02/datafusion:arrow 164572210 169782235 0.97
tpch_q03/datafusion:arrow 461088965 486600012 0.95
tpch_q04/datafusion:arrow 337559159 360278136 0.94
tpch_q05/datafusion:arrow 949879171 980764665 0.97
tpch_q06/datafusion:arrow 🚨 357887122 300139110 1.19
tpch_q07/datafusion:arrow 🚨 1494781623 1209271862 1.24
tpch_q08/datafusion:arrow 1104557706 1202558237 0.92
tpch_q09/datafusion:arrow 1309744846 1392899490 0.94
tpch_q10/datafusion:arrow 577071123 617331630 0.93
tpch_q11/datafusion:arrow 138088358 141093947 0.98
tpch_q12/datafusion:arrow 🚀 650361172 764448499 0.85
tpch_q13/datafusion:arrow 495492470 512582298 0.97
tpch_q14/datafusion:arrow 313006769 333113094 0.94
tpch_q15/datafusion:arrow 702768628 731769369 0.96
tpch_q16/datafusion:arrow 104331257 108771773 0.96
tpch_q17/datafusion:arrow 1324061747 1375927983 0.96
tpch_q18/datafusion:arrow 🚨 2350055131 1964246255 1.20
tpch_q19/datafusion:arrow 480191247 503090933 0.95
tpch_q20/datafusion:arrow 476597744 513003157 0.93
tpch_q21/datafusion:arrow 2978239730 3068286859 0.97
tpch_q22/datafusion:arrow 129635427 137143911 0.95
duckdb / vortex-file-compressed (1.001x ➖, 0↑ 3↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 173133351 172696468 1.00
tpch_q02/duckdb:vortex-file-compressed 53261831 55528954 0.96
tpch_q03/duckdb:vortex-file-compressed 125236703 130490918 0.96
tpch_q04/duckdb:vortex-file-compressed 163195179 168356205 0.97
tpch_q05/duckdb:vortex-file-compressed 🚨 160538905 140691309 1.14
tpch_q06/duckdb:vortex-file-compressed 36459657 34621932 1.05
tpch_q07/duckdb:vortex-file-compressed 🚨 158272209 138083338 1.15
tpch_q08/duckdb:vortex-file-compressed 🚨 195485138 175993912 1.11
tpch_q09/duckdb:vortex-file-compressed 392699542 398142100 0.99
tpch_q10/duckdb:vortex-file-compressed 186662166 192820345 0.97
tpch_q11/duckdb:vortex-file-compressed 32366354 33444654 0.97
tpch_q12/duckdb:vortex-file-compressed 99629248 101829442 0.98
tpch_q13/duckdb:vortex-file-compressed 228267071 236653131 0.96
tpch_q14/duckdb:vortex-file-compressed 56401108 56385309 1.00
tpch_q15/duckdb:vortex-file-compressed 90798913 92359593 0.98
tpch_q16/duckdb:vortex-file-compressed 77508721 77628644 1.00
tpch_q17/duckdb:vortex-file-compressed 95853065 98216108 0.98
tpch_q18/duckdb:vortex-file-compressed 283379203 290433492 0.98
tpch_q19/duckdb:vortex-file-compressed 78150123 78947088 0.99
tpch_q20/duckdb:vortex-file-compressed 153098531 157720512 0.97
tpch_q21/duckdb:vortex-file-compressed 487813253 499429072 0.98
tpch_q22/duckdb:vortex-file-compressed 64352009 66318914 0.97
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228131520 229819074 0.99
tpch_q02/duckdb:vortex-compact 60254905 59438466 1.01
tpch_q03/duckdb:vortex-compact 138792886 142365404 0.97
tpch_q04/duckdb:vortex-compact 174144501 177506966 0.98
tpch_q05/duckdb:vortex-compact 166305066 171816413 0.97
tpch_q06/duckdb:vortex-compact 57839792 57358029 1.01
tpch_q07/duckdb:vortex-compact 173581819 179535448 0.97
tpch_q08/duckdb:vortex-compact 187375534 196328985 0.95
tpch_q09/duckdb:vortex-compact 428688130 437734179 0.98
tpch_q10/duckdb:vortex-compact 219277424 227222272 0.97
tpch_q11/duckdb:vortex-compact 38226026 40058533 0.95
tpch_q12/duckdb:vortex-compact 162624643 166864748 0.97
tpch_q13/duckdb:vortex-compact 274698269 282011889 0.97
tpch_q14/duckdb:vortex-compact 71976885 75389962 0.95
tpch_q15/duckdb:vortex-compact 114212323 118102966 0.97
tpch_q16/duckdb:vortex-compact 80212680 82629210 0.97
tpch_q17/duckdb:vortex-compact 108631111 111360397 0.98
tpch_q18/duckdb:vortex-compact 286510222 293379747 0.98
tpch_q19/duckdb:vortex-compact 94675728 97158543 0.97
tpch_q20/duckdb:vortex-compact 183150681 188568100 0.97
tpch_q21/duckdb:vortex-compact 518768951 534496755 0.97
tpch_q22/duckdb:vortex-compact 71425347 72630784 0.98
duckdb / parquet (0.994x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260481241 265315869 0.98
tpch_q02/duckdb:parquet 103087569 96929878 1.06
tpch_q03/duckdb:parquet 212132124 213754884 0.99
tpch_q04/duckdb:parquet 129120683 139270924 0.93
tpch_q05/duckdb:parquet 227397006 230452079 0.99
tpch_q06/duckdb:parquet 73428262 74901942 0.98
tpch_q07/duckdb:parquet 188716744 190263450 0.99
tpch_q08/duckdb:parquet 268273738 271088605 0.99
tpch_q09/duckdb:parquet 507024065 477618290 1.06
tpch_q10/duckdb:parquet 621753338 626963842 0.99
tpch_q11/duckdb:parquet 69522753 65282863 1.06
tpch_q12/duckdb:parquet 131473934 135815125 0.97
tpch_q13/duckdb:parquet 446213528 448355212 1.00
tpch_q14/duckdb:parquet 177673629 183673432 0.97
tpch_q15/duckdb:parquet 103445644 105752893 0.98
tpch_q16/duckdb:parquet 162034941 164291045 0.99
tpch_q17/duckdb:parquet 181337315 180405460 1.01
tpch_q18/duckdb:parquet 364522536 370535959 0.98
tpch_q19/duckdb:parquet 284796338 285625744 1.00
tpch_q20/duckdb:parquet 225646416 229291533 0.98
tpch_q21/duckdb:parquet 563956959 570545021 0.99
tpch_q22/duckdb:parquet 294342667 296046844 0.99
duckdb / duckdb (0.975x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119625184 120319143 0.99
tpch_q02/duckdb:duckdb 48703847 52207518 0.93
tpch_q03/duckdb:duckdb 104382397 105041881 0.99
tpch_q04/duckdb:duckdb 137983164 142266850 0.97
tpch_q05/duckdb:duckdb 119018167 122520504 0.97
tpch_q06/duckdb:duckdb 44767118 45199309 0.99
tpch_q07/duckdb:duckdb 90705747 93035882 0.97
tpch_q08/duckdb:duckdb 118428051 119933396 0.99
tpch_q09/duckdb:duckdb 279728370 287373047 0.97
tpch_q10/duckdb:duckdb 214772611 220877652 0.97
tpch_q11/duckdb:duckdb 19147580 19763711 0.97
tpch_q12/duckdb:duckdb 89983153 91334527 0.99
tpch_q13/duckdb:duckdb 229440355 239389501 0.96
tpch_q14/duckdb:duckdb 77828494 80129537 0.97
tpch_q15/duckdb:duckdb 81776928 83071594 0.98
tpch_q16/duckdb:duckdb 76052030 79438260 0.96
tpch_q17/duckdb:duckdb 87407487 88318314 0.99
tpch_q18/duckdb:duckdb 233005560 236839087 0.98
tpch_q19/duckdb:duckdb 123759822 126839197 0.98
tpch_q20/duckdb:duckdb 117152224 119256928 0.98
tpch_q21/duckdb:duckdb 301875324 315532920 0.96
tpch_q22/duckdb:duckdb 68008105 68961088 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -3.4% -3.2% -0.2% +11.2% ➖ noise
1 datafusion:vortex-compact +23.1% -3.2% +27.1% +11.2% 🚨 regression
1 datafusion:vortex-file-compressed +0.1% -3.2% +3.4% +11.2% ➖ noise
1 duckdb:duckdb -0.6% -3.2% +2.7% +11.2% ➖ noise
1 duckdb:vortex-compact -0.7% -3.2% +2.5% +11.2% ➖ noise
1 duckdb:vortex-file-compressed +0.3% -3.2% +3.5% +11.2% ➖ noise
2 datafusion:arrow -3.1% +2.8% -5.7% +11.2% ➖ noise
2 datafusion:vortex-compact +23.7% +2.8% +20.4% +11.2% 🚨 regression
2 datafusion:vortex-file-compressed -4.1% +2.8% -6.7% +11.2% ➖ noise
2 duckdb:duckdb -6.7% +2.8% -9.3% +11.2% ➖ noise
2 duckdb:vortex-compact +1.4% +2.8% -1.4% +11.2% ➖ noise
2 duckdb:vortex-file-compressed -4.1% +2.8% -6.7% +11.2% ➖ noise
3 datafusion:arrow -5.2% -1.6% -3.7% +11.2% ➖ noise
3 datafusion:vortex-compact +27.7% -1.6% +29.9% +11.2% 🚨 regression
3 datafusion:vortex-file-compressed -3.8% -1.6% -2.2% +11.2% ➖ noise
3 duckdb:duckdb -0.6% -1.6% +1.0% +11.2% ➖ noise
3 duckdb:vortex-compact -2.5% -1.6% -0.9% +11.2% ➖ noise
3 duckdb:vortex-file-compressed -4.0% -1.6% -2.4% +11.2% ➖ noise
4 datafusion:arrow -6.3% -6.0% -0.4% +11.2% ➖ noise
4 datafusion:vortex-compact +19.8% -6.0% +27.4% +11.2% 🚨 regression
4 datafusion:vortex-file-compressed -0.5% -6.0% +5.9% +11.2% ➖ noise
4 duckdb:duckdb -3.0% -6.0% +3.1% +11.2% ➖ noise
4 duckdb:vortex-compact -1.9% -6.0% +4.3% +11.2% ➖ noise
4 duckdb:vortex-file-compressed -3.1% -6.0% +3.1% +11.2% ➖ noise
5 datafusion:arrow -3.1% -3.0% -0.2% +11.2% ➖ noise
5 datafusion:vortex-compact -4.1% -3.0% -1.1% +11.2% ➖ noise
5 datafusion:vortex-file-compressed +24.4% -3.0% +28.2% +11.2% 🚨 regression
5 duckdb:duckdb -2.9% -3.0% +0.1% +11.2% ➖ noise
5 duckdb:vortex-compact -3.2% -3.0% -0.2% +11.2% ➖ noise
5 duckdb:vortex-file-compressed +14.1% -3.0% +17.6% +11.2% 🚨 regression
6 datafusion:arrow +19.2% +5.4% +13.1% +11.2% 🚨 regression
6 datafusion:vortex-compact -1.8% +5.4% -6.8% +11.2% ➖ noise
6 datafusion:vortex-file-compressed +22.7% +5.4% +16.4% +11.2% 🚨 regression
6 duckdb:duckdb -1.0% +5.4% -6.0% +11.2% ➖ noise
6 duckdb:vortex-compact +0.8% +5.4% -4.3% +11.2% ➖ noise
6 duckdb:vortex-file-compressed +5.3% +5.4% -0.1% +12.9% ➖ noise
7 datafusion:arrow +23.6% +11.3% +11.1% +11.9% ➖ noise
7 datafusion:vortex-compact -2.5% +11.3% -12.4% +11.2% ✅ faster
7 datafusion:vortex-file-compressed +28.0% +11.3% +15.0% +11.2% 🚨 regression
7 duckdb:duckdb -2.5% +11.3% -12.4% +11.2% ✅ faster
7 duckdb:vortex-compact -3.3% +11.3% -13.1% +11.2% ✅ faster
7 duckdb:vortex-file-compressed +14.6% +11.3% +3.0% +11.2% ➖ noise
8 datafusion:arrow -8.1% +8.7% -15.5% +11.3% ✅ faster
8 datafusion:vortex-compact -4.4% +8.7% -12.1% +11.2% ✅ faster
8 datafusion:vortex-file-compressed -2.9% +8.7% -10.6% +11.2% ✅ faster
8 duckdb:duckdb -1.3% +8.7% -9.2% +11.2% ➖ noise
8 duckdb:vortex-compact -4.6% +8.7% -12.2% +11.2% ✅ faster
8 duckdb:vortex-file-compressed +11.1% +8.7% +2.2% +11.2% ➖ noise
9 datafusion:arrow -6.0% +1.5% -7.4% +11.2% ➖ noise
9 datafusion:vortex-compact -3.7% +1.5% -5.2% +11.2% ➖ noise
9 datafusion:vortex-file-compressed -4.4% +1.5% -5.8% +11.2% ➖ noise
9 duckdb:duckdb -2.7% +1.5% -4.1% +11.2% ➖ noise
9 duckdb:vortex-compact -2.1% +1.5% -3.5% +11.2% ➖ noise
9 duckdb:vortex-file-compressed -1.4% +1.5% -2.8% +11.2% ➖ noise
10 datafusion:arrow -6.5% -1.1% -5.5% +11.2% ➖ noise
10 datafusion:vortex-compact -2.7% -1.1% -1.6% +11.2% ➖ noise
10 datafusion:vortex-file-compressed -3.7% -1.1% -2.6% +11.2% ➖ noise
10 duckdb:duckdb -2.8% -1.1% -1.7% +11.2% ➖ noise
10 duckdb:vortex-compact -3.5% -1.1% -2.4% +11.2% ➖ noise
10 duckdb:vortex-file-compressed -3.2% -1.1% -2.1% +11.2% ➖ noise
11 datafusion:arrow -2.1% +0.8% -2.9% +11.2% ➖ noise
11 datafusion:vortex-compact -2.5% +0.8% -3.3% +11.2% ➖ noise
11 datafusion:vortex-file-compressed -2.8% +0.8% -3.6% +11.2% ➖ noise
11 duckdb:duckdb -3.1% +0.8% -3.9% +11.2% ➖ noise
11 duckdb:vortex-compact -4.6% +0.8% -5.4% +12.5% ➖ noise
11 duckdb:vortex-file-compressed -3.2% +0.8% -4.0% +11.2% ➖ noise
12 datafusion:arrow -14.9% -2.7% -12.6% +37.6% ➖ noise
12 datafusion:vortex-compact -1.9% -2.7% +0.8% +11.2% ➖ noise
12 datafusion:vortex-file-compressed -3.8% -2.7% -1.2% +11.2% ➖ noise
12 duckdb:duckdb -1.5% -2.7% +1.2% +11.2% ➖ noise
12 duckdb:vortex-compact -2.5% -2.7% +0.2% +11.2% ➖ noise
12 duckdb:vortex-file-compressed -2.2% -2.7% +0.5% +11.2% ➖ noise
13 datafusion:arrow -3.3% -1.4% -1.9% +11.2% ➖ noise
13 datafusion:vortex-compact -2.8% -1.4% -1.3% +11.2% ➖ noise
13 datafusion:vortex-file-compressed -3.6% -1.4% -2.1% +11.2% ➖ noise
13 duckdb:duckdb -4.2% -1.4% -2.8% +11.2% ➖ noise
13 duckdb:vortex-compact -2.6% -1.4% -1.2% +11.2% ➖ noise
13 duckdb:vortex-file-compressed -3.5% -1.4% -2.1% +11.2% ➖ noise
14 datafusion:arrow -6.0% -3.6% -2.6% +11.2% ➖ noise
14 datafusion:vortex-compact -0.7% -3.6% +2.9% +11.2% ➖ noise
14 datafusion:vortex-file-compressed -3.8% -3.6% -0.2% +11.2% ➖ noise
14 duckdb:duckdb -2.9% -3.6% +0.7% +11.2% ➖ noise
14 duckdb:vortex-compact -4.5% -3.6% -1.0% +11.2% ➖ noise
14 duckdb:vortex-file-compressed +0.0% -3.6% +3.7% +11.2% ➖ noise
15 datafusion:arrow -4.0% -4.6% +0.7% +11.2% ➖ noise
15 datafusion:vortex-compact -1.9% -4.6% +2.8% +11.2% ➖ noise
15 datafusion:vortex-file-compressed -3.1% -4.6% +1.6% +11.2% ➖ noise
15 duckdb:duckdb -1.6% -4.6% +3.2% +11.2% ➖ noise
15 duckdb:vortex-compact -3.3% -4.6% +1.4% +11.2% ➖ noise
15 duckdb:vortex-file-compressed -1.7% -4.6% +3.1% +11.2% ➖ noise
16 datafusion:arrow -4.1% -1.7% -2.4% +11.2% ➖ noise
16 datafusion:vortex-compact -0.7% -1.7% +1.0% +11.2% ➖ noise
16 datafusion:vortex-file-compressed -1.8% -1.7% -0.0% +11.2% ➖ noise
16 duckdb:duckdb -4.3% -1.7% -2.6% +11.2% ➖ noise
16 duckdb:vortex-compact -2.9% -1.7% -1.2% +11.2% ➖ noise
16 duckdb:vortex-file-compressed -0.2% -1.7% +1.6% +11.2% ➖ noise
17 datafusion:arrow -3.8% -2.0% -1.8% +11.2% ➖ noise
17 datafusion:vortex-compact -2.3% -2.0% -0.3% +11.2% ➖ noise
17 datafusion:vortex-file-compressed -1.8% -2.0% +0.2% +11.2% ➖ noise
17 duckdb:duckdb -1.0% -2.0% +1.0% +11.2% ➖ noise
17 duckdb:vortex-compact -2.5% -2.0% -0.5% +11.2% ➖ noise
17 duckdb:vortex-file-compressed -2.4% -2.0% -0.4% +11.2% ➖ noise
18 datafusion:arrow +19.6% -3.2% +23.6% +11.2% 🚨 regression
18 datafusion:vortex-compact -2.4% -3.2% +0.8% +11.2% ➖ noise
18 datafusion:vortex-file-compressed -1.3% -3.2% +2.0% +11.2% ➖ noise
18 duckdb:duckdb -1.6% -3.2% +1.7% +11.2% ➖ noise
18 duckdb:vortex-compact -2.3% -3.2% +0.9% +11.2% ➖ noise
18 duckdb:vortex-file-compressed -2.4% -3.2% +0.8% +11.2% ➖ noise
19 datafusion:arrow -4.6% -1.0% -3.6% +11.2% ➖ noise
19 datafusion:vortex-compact +10.6% -1.0% +11.7% +11.2% 🚨 regression
19 datafusion:vortex-file-compressed +18.1% -1.0% +19.3% +11.2% 🚨 regression
19 duckdb:duckdb -2.4% -1.0% -1.4% +11.2% ➖ noise
19 duckdb:vortex-compact -2.6% -1.0% -1.6% +11.2% ➖ noise
19 duckdb:vortex-file-compressed -1.0% -1.0% +0.0% +11.2% ➖ noise
20 datafusion:arrow -7.1% -3.2% -4.0% +11.2% ➖ noise
20 datafusion:vortex-compact +23.4% -3.2% +27.5% +11.2% 🚨 regression
20 datafusion:vortex-file-compressed +23.8% -3.2% +27.9% +11.2% 🚨 regression
20 duckdb:duckdb -1.8% -3.2% +1.5% +11.2% ➖ noise
20 duckdb:vortex-compact -2.9% -3.2% +0.4% +11.2% ➖ noise
20 duckdb:vortex-file-compressed -2.9% -3.2% +0.3% +11.2% ➖ noise
21 datafusion:arrow -2.9% -2.4% -0.5% +11.2% ➖ noise
21 datafusion:vortex-compact +28.2% -2.4% +31.3% +11.2% 🚨 regression
21 datafusion:vortex-file-compressed +29.0% -2.4% +32.2% +11.2% 🚨 regression
21 duckdb:duckdb -4.3% -2.4% -2.0% +11.2% ➖ noise
21 duckdb:vortex-compact -2.9% -2.4% -0.5% +11.2% ➖ noise
21 duckdb:vortex-file-compressed -2.3% -2.4% +0.1% +11.2% ➖ noise
22 datafusion:arrow -5.5% -0.7% -4.8% +11.2% ➖ noise
22 datafusion:vortex-compact +16.3% -0.7% +17.1% +11.2% 🚨 regression
22 datafusion:vortex-file-compressed +13.4% -0.7% +14.2% +11.4% 🚨 regression
22 duckdb:duckdb -1.4% -0.7% -0.7% +11.2% ➖ noise
22 duckdb:vortex-compact -1.7% -0.7% -0.9% +11.2% ➖ noise
22 duckdb:vortex-file-compressed -3.0% -0.7% -2.3% +11.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

File Size Changes (48 files changed, -0.0% overall, 0↑ 48↓)
File Scale Format Base HEAD Change %
partsupp_1.vortex 10.0 vortex-file-compressed 180.65 MB 180.65 MB 32 B -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 180.47 MB 180.47 MB 32 B -0.0%
orders_1.vortex 10.0 vortex-file-compressed 164.15 MB 164.15 MB 32 B -0.0%
orders_2.vortex 10.0 vortex-file-compressed 164.00 MB 164.00 MB 32 B -0.0%
orders_0.vortex 10.0 vortex-file-compressed 163.92 MB 163.92 MB 32 B -0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.87 MB 134.87 MB 32 B -0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 32 B -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 32 B -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.52 MB 134.52 MB 32 B -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.51 MB 134.51 MB 32 B -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.43 MB 134.43 MB 32 B -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.38 MB 134.38 MB 32 B -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 134.27 MB 134.27 MB 32 B -0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 134.06 MB 134.06 MB 32 B -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 134.01 MB 134.01 MB 32 B -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.86 MB 133.86 MB 32 B -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.74 MB 133.74 MB 32 B -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 133.23 MB 133.23 MB 32 B -0.0%
partsupp_0.vortex 10.0 vortex-compact 126.76 MB 126.76 MB 32 B -0.0%
partsupp_1.vortex 10.0 vortex-compact 126.74 MB 126.74 MB 32 B -0.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 114.79 MB 32 B -0.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 114.78 MB 32 B -0.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 114.76 MB 32 B -0.0%
customer_0.vortex 10.0 vortex-file-compressed 104.73 MB 104.73 MB 32 B -0.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 100.70 MB 32 B -0.0%
lineitem_6.vortex 10.0 vortex-compact 100.68 MB 100.68 MB 32 B -0.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 100.64 MB 32 B -0.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_10.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_3.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 32 B -0.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_2.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 32 B -0.0%
lineitem_7.vortex 10.0 vortex-compact 100.58 MB 100.58 MB 32 B -0.0%
lineitem_4.vortex 10.0 vortex-compact 100.56 MB 100.56 MB 32 B -0.0%
lineitem_11.vortex 10.0 vortex-compact 100.53 MB 100.53 MB 32 B -0.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 100.46 MB 32 B -0.0%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.12 MB 32 B -0.0%
part_0.vortex 10.0 vortex-file-compressed 27.02 MB 27.02 MB 32 B -0.0%
part_1.vortex 10.0 vortex-file-compressed 26.99 MB 26.99 MB 32 B -0.0%
part_1.vortex 10.0 vortex-compact 18.11 MB 18.11 MB 32 B -0.0%
part_0.vortex 10.0 vortex-compact 18.11 MB 18.11 MB 32 B -0.0%
supplier_0.vortex 10.0 vortex-file-compressed 6.69 MB 6.69 MB 32 B -0.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 4.73 MB 32 B -0.0%
nation_0.vortex 10.0 vortex-file-compressed 11.00 KB 10.97 KB 32 B -0.3%
nation_0.vortex 10.0 vortex-compact 8.34 KB 8.31 KB 32 B -0.4%
region_0.vortex 10.0 vortex-file-compressed 6.16 KB 6.13 KB 32 B -0.5%
region_0.vortex 10.0 vortex-compact 5.86 KB 5.82 KB 32 B -0.5%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (-0.0%)
  • vortex-file-compressed: 2.70 GB → 2.70 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.2%


datafusion / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1658284 1639718 1.01
clickbench_q01/datafusion:vortex-file-compressed 20238894 19296180 1.05
clickbench_q02/datafusion:vortex-file-compressed 38118103 36878982 1.03
clickbench_q03/datafusion:vortex-file-compressed 43017882 42904791 1.00
clickbench_q04/datafusion:vortex-file-compressed 281482639 283840590 0.99
clickbench_q05/datafusion:vortex-file-compressed 305983000 305146088 1.00
clickbench_q06/datafusion:vortex-file-compressed 1643081 1646273 1.00
clickbench_q07/datafusion:vortex-file-compressed 22392918 22826779 0.98
clickbench_q08/datafusion:vortex-file-compressed 348674450 350613803 0.99
clickbench_q09/datafusion:vortex-file-compressed 556453711 537972807 1.03
clickbench_q10/datafusion:vortex-file-compressed 75512828 76777749 0.98
clickbench_q11/datafusion:vortex-file-compressed 85203000 87847037 0.97
clickbench_q12/datafusion:vortex-file-compressed 267713935 264772576 1.01
clickbench_q13/datafusion:vortex-file-compressed 418348315 416531893 1.00
clickbench_q14/datafusion:vortex-file-compressed 254503926 253053820 1.01
clickbench_q15/datafusion:vortex-file-compressed 327549997 327397247 1.00
clickbench_q16/datafusion:vortex-file-compressed 638804241 639806981 1.00
clickbench_q17/datafusion:vortex-file-compressed 640434620 637194761 1.01
clickbench_q18/datafusion:vortex-file-compressed 1290166524 1288848735 1.00
clickbench_q19/datafusion:vortex-file-compressed 29635295 30979843 0.96
clickbench_q20/datafusion:vortex-file-compressed 345881730 347500485 1.00
clickbench_q21/datafusion:vortex-file-compressed 372043306 379320508 0.98
clickbench_q22/datafusion:vortex-file-compressed 454598508 451858410 1.01
clickbench_q23/datafusion:vortex-file-compressed 648138905 655823808 0.99
clickbench_q24/datafusion:vortex-file-compressed 45327836 45710963 0.99
clickbench_q25/datafusion:vortex-file-compressed 71243620 69486597 1.03
clickbench_q26/datafusion:vortex-file-compressed 45981323 45642174 1.01
clickbench_q27/datafusion:vortex-file-compressed 717107215 739257217 0.97
clickbench_q28/datafusion:vortex-file-compressed 6524011862 6609435027 0.99
clickbench_q29/datafusion:vortex-file-compressed 238895711 234966765 1.02
clickbench_q30/datafusion:vortex-file-compressed 218575164 219072417 1.00
clickbench_q31/datafusion:vortex-file-compressed 255247261 256558274 0.99
clickbench_q32/datafusion:vortex-file-compressed 1103783422 1099442472 1.00
clickbench_q33/datafusion:vortex-file-compressed 1302205417 1291624688 1.01
clickbench_q34/datafusion:vortex-file-compressed 1296251320 1283204564 1.01
clickbench_q35/datafusion:vortex-file-compressed 453197578 446651264 1.01
clickbench_q36/datafusion:vortex-file-compressed 70535646 69320145 1.02
clickbench_q37/datafusion:vortex-file-compressed 33817464 33630245 1.01
clickbench_q38/datafusion:vortex-file-compressed 18317248 17894848 1.02
clickbench_q39/datafusion:vortex-file-compressed 130555553 128576112 1.02
clickbench_q40/datafusion:vortex-file-compressed 15789204 15559469 1.01
clickbench_q41/datafusion:vortex-file-compressed 14569836 14233766 1.02
clickbench_q42/datafusion:vortex-file-compressed 16306664 16506380 0.99
datafusion / parquet (0.990x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1613940 1763254 0.92
clickbench_q01/datafusion:parquet 19428773 19008000 1.02
clickbench_q02/datafusion:parquet 45923275 48242062 0.95
clickbench_q03/datafusion:parquet 37915611 38592960 0.98
clickbench_q04/datafusion:parquet 300186511 313027524 0.96
clickbench_q05/datafusion:parquet 358509658 346711726 1.03
clickbench_q06/datafusion:parquet 1536633 1559298 0.99
clickbench_q07/datafusion:parquet 22478266 22144921 1.02
clickbench_q08/datafusion:parquet 371571890 365685574 1.02
clickbench_q09/datafusion:parquet 618995461 616873085 1.00
clickbench_q10/datafusion:parquet 104790695 105628558 0.99
clickbench_q11/datafusion:parquet 129234454 129098413 1.00
clickbench_q12/datafusion:parquet 336286253 344767671 0.98
clickbench_q13/datafusion:parquet 477350336 512847939 0.93
clickbench_q14/datafusion:parquet 340854171 342073391 1.00
clickbench_q15/datafusion:parquet 337554536 337525409 1.00
clickbench_q16/datafusion:parquet 649492199 661119339 0.98
clickbench_q17/datafusion:parquet 643236896 641902169 1.00
clickbench_q18/datafusion:parquet 1312573147 1377661843 0.95
clickbench_q19/datafusion:parquet 29168798 30345476 0.96
clickbench_q20/datafusion:parquet 601011575 615347925 0.98
clickbench_q21/datafusion:parquet 657765978 665193295 0.99
clickbench_q22/datafusion:parquet 973504467 995815329 0.98
clickbench_q23/datafusion:parquet 3647878581 3685088390 0.99
clickbench_q24/datafusion:parquet 84536109 84878991 1.00
clickbench_q25/datafusion:parquet 129572820 136011788 0.95
clickbench_q26/datafusion:parquet 84215015 82320290 1.02
clickbench_q27/datafusion:parquet 1049789356 1056403390 0.99
clickbench_q28/datafusion:parquet 6453736930 6630636768 0.97
clickbench_q29/datafusion:parquet 238326542 238721262 1.00
clickbench_q30/datafusion:parquet 322036717 323835434 0.99
clickbench_q31/datafusion:parquet 363633641 365657061 0.99
clickbench_q32/datafusion:parquet 1149225552 1149160587 1.00
clickbench_q33/datafusion:parquet 1475309899 1455515851 1.01
clickbench_q34/datafusion:parquet 1483915990 1462881213 1.01
clickbench_q35/datafusion:parquet 455374270 449519947 1.01
clickbench_q36/datafusion:parquet 133893132 137054046 0.98
clickbench_q37/datafusion:parquet 56202032 56065267 1.00
clickbench_q38/datafusion:parquet 82757616 82248980 1.01
clickbench_q39/datafusion:parquet 256066228 257507199 0.99
clickbench_q40/datafusion:parquet 29491248 29098316 1.01
clickbench_q41/datafusion:parquet 27295413 26619083 1.03
clickbench_q42/datafusion:parquet 28595784 29261683 0.98
duckdb / vortex-file-compressed (1.000x ➖, 1↑ 2↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 6259063 7673728 0.82
clickbench_q01/duckdb:vortex-file-compressed 12140839 11941061 1.02
clickbench_q02/duckdb:vortex-file-compressed 26398957 26442109 1.00
clickbench_q03/duckdb:vortex-file-compressed 30526385 31686483 0.96
clickbench_q04/duckdb:vortex-file-compressed 185113590 187680974 0.99
clickbench_q05/duckdb:vortex-file-compressed 173022095 172694321 1.00
clickbench_q06/duckdb:vortex-file-compressed 19815326 20499726 0.97
clickbench_q07/duckdb:vortex-file-compressed 15641308 16548078 0.95
clickbench_q08/duckdb:vortex-file-compressed 262739423 260235624 1.01
clickbench_q09/duckdb:vortex-file-compressed 338801520 342236441 0.99
clickbench_q10/duckdb:vortex-file-compressed 66732377 68580060 0.97
clickbench_q11/duckdb:vortex-file-compressed 76977802 77309919 1.00
clickbench_q12/duckdb:vortex-file-compressed 195616220 199561345 0.98
clickbench_q13/duckdb:vortex-file-compressed 399708601 404195624 0.99
clickbench_q14/duckdb:vortex-file-compressed 226478668 228228864 0.99
clickbench_q15/duckdb:vortex-file-compressed 243492864 237573772 1.02
clickbench_q16/duckdb:vortex-file-compressed 523548055 519559139 1.01
clickbench_q17/duckdb:vortex-file-compressed 423243650 422253059 1.00
clickbench_q18/duckdb:vortex-file-compressed 940214139 934469826 1.01
clickbench_q19/duckdb:vortex-file-compressed 21336325 21388470 1.00
clickbench_q20/duckdb:vortex-file-compressed 331422469 332447697 1.00
clickbench_q21/duckdb:vortex-file-compressed 364639310 357593290 1.02
clickbench_q22/duckdb:vortex-file-compressed 🚨 580595670 523671174 1.11
clickbench_q23/duckdb:vortex-file-compressed 192306608 203107868 0.95
clickbench_q24/duckdb:vortex-file-compressed 35207869 34828477 1.01
clickbench_q25/duckdb:vortex-file-compressed 72743134 66672916 1.09
clickbench_q26/duckdb:vortex-file-compressed 46030819 43989508 1.05
clickbench_q27/duckdb:vortex-file-compressed 485957848 477635119 1.02
clickbench_q28/duckdb:vortex-file-compressed 3013338498 2997724658 1.01
clickbench_q29/duckdb:vortex-file-compressed 29702601 27876130 1.07
clickbench_q30/duckdb:vortex-file-compressed 189406625 191918698 0.99
clickbench_q31/duckdb:vortex-file-compressed 285378112 292875038 0.97
clickbench_q32/duckdb:vortex-file-compressed 1111577164 1124205791 0.99
clickbench_q33/duckdb:vortex-file-compressed 1051952902 1090811338 0.96
clickbench_q34/duckdb:vortex-file-compressed 1163937493 1162770131 1.00
clickbench_q35/duckdb:vortex-file-compressed 372590762 373924959 1.00
clickbench_q36/duckdb:vortex-file-compressed 27104224 26633136 1.02
clickbench_q37/duckdb:vortex-file-compressed 20472258 19484796 1.05
clickbench_q38/duckdb:vortex-file-compressed 20759399 20707424 1.00
clickbench_q39/duckdb:vortex-file-compressed 40368137 41141496 0.98
clickbench_q40/duckdb:vortex-file-compressed 19517472 19967653 0.98
clickbench_q41/duckdb:vortex-file-compressed 🚨 21140876 18754061 1.13
clickbench_q42/duckdb:vortex-file-compressed 19180981 18631143 1.03
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22550436 22416712 1.01
clickbench_q01/duckdb:parquet 29685448 29505403 1.01
clickbench_q02/duckdb:parquet 49567527 50927738 0.97
clickbench_q03/duckdb:parquet 39615140 40667513 0.97
clickbench_q04/duckdb:parquet 202881639 204369278 0.99
clickbench_q05/duckdb:parquet 257967727 260378928 0.99
clickbench_q06/duckdb:parquet 47378658 48543785 0.98
clickbench_q07/duckdb:parquet 31072065 32384993 0.96
clickbench_q08/duckdb:parquet 271788087 269090569 1.01
clickbench_q09/duckdb:parquet 399549407 402696307 0.99
clickbench_q10/duckdb:parquet 81570122 81225777 1.00
clickbench_q11/duckdb:parquet 99226239 101504270 0.98
clickbench_q12/duckdb:parquet 281080771 280605035 1.00
clickbench_q13/duckdb:parquet 468863423 466058952 1.01
clickbench_q14/duckdb:parquet 315966716 316031825 1.00
clickbench_q15/duckdb:parquet 254042417 256170294 0.99
clickbench_q16/duckdb:parquet 599463173 595416284 1.01
clickbench_q17/duckdb:parquet 498733987 496039969 1.01
clickbench_q18/duckdb:parquet 1037034563 1035479488 1.00
clickbench_q19/duckdb:parquet 28332788 28100382 1.01
clickbench_q20/duckdb:parquet 410647232 412177095 1.00
clickbench_q21/duckdb:parquet 534203372 533180680 1.00
clickbench_q22/duckdb:parquet 917204645 922008180 0.99
clickbench_q23/duckdb:parquet 263401285 264797261 0.99
clickbench_q24/duckdb:parquet 72511329 69341531 1.05
clickbench_q25/duckdb:parquet 163888390 162600060 1.01
clickbench_q26/duckdb:parquet 54318984 56139533 0.97
clickbench_q27/duckdb:parquet 640433622 642342297 1.00
clickbench_q28/duckdb:parquet 4857252325 4859268219 1.00
clickbench_q29/duckdb:parquet 42087505 41822069 1.01
clickbench_q30/duckdb:parquet 314295543 309661610 1.01
clickbench_q31/duckdb:parquet 374181614 375057954 1.00
clickbench_q32/duckdb:parquet 1099807561 1105444538 0.99
clickbench_q33/duckdb:parquet 1099349841 1102710759 1.00
clickbench_q34/duckdb:parquet 1153114718 1148222999 1.00
clickbench_q35/duckdb:parquet 373049712 369073991 1.01
clickbench_q36/duckdb:parquet 50238049 46529338 1.08
clickbench_q37/duckdb:parquet 33374629 34374539 0.97
clickbench_q38/duckdb:parquet 34399795 35754365 0.96
clickbench_q39/duckdb:parquet 80024973 75943040 1.05
clickbench_q40/duckdb:parquet 20620798 20400333 1.01
clickbench_q41/duckdb:parquet 20236024 20566775 0.98
clickbench_q42/duckdb:parquet 21692654 22441200 0.97
duckdb / duckdb (0.984x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17244954 17499273 0.99
clickbench_q01/duckdb:duckdb 33945358 33989023 1.00
clickbench_q02/duckdb:duckdb 50824416 50985958 1.00
clickbench_q03/duckdb:duckdb 55958466 55502717 1.01
clickbench_q04/duckdb:duckdb 208205452 215571118 0.97
clickbench_q05/duckdb:duckdb 285495591 293096780 0.97
clickbench_q06/duckdb:duckdb 33648883 35628500 0.94
clickbench_q07/duckdb:duckdb 34948870 35577864 0.98
clickbench_q08/duckdb:duckdb 272218953 280782979 0.97
clickbench_q09/duckdb:duckdb 392235564 397654789 0.99
clickbench_q10/duckdb:duckdb 115944296 118913113 0.98
clickbench_q11/duckdb:duckdb 126902625 127521482 1.00
clickbench_q12/duckdb:duckdb 260118824 262812617 0.99
clickbench_q13/duckdb:duckdb 448809838 460514618 0.97
clickbench_q14/duckdb:duckdb 285083029 296779051 0.96
clickbench_q15/duckdb:duckdb 241056681 245434984 0.98
clickbench_q16/duckdb:duckdb 562247911 565139968 0.99
clickbench_q17/duckdb:duckdb 470298214 475796576 0.99
clickbench_q18/duckdb:duckdb 986681230 1014679115 0.97
clickbench_q19/duckdb:duckdb 35167073 35051710 1.00
clickbench_q20/duckdb:duckdb 491507727 491594026 1.00
clickbench_q21/duckdb:duckdb 493938845 495280638 1.00
clickbench_q22/duckdb:duckdb 536400106 565467994 0.95
clickbench_q23/duckdb:duckdb 249894753 269948015 0.93
clickbench_q24/duckdb:duckdb 61914378 61196161 1.01
clickbench_q25/duckdb:duckdb 148149184 148660531 1.00
clickbench_q26/duckdb:duckdb 61254790 62837311 0.97
clickbench_q27/duckdb:duckdb 552644423 547980810 1.01
clickbench_q28/duckdb:duckdb 4510602534 4514159060 1.00
clickbench_q29/duckdb:duckdb 50305439 50523955 1.00
clickbench_q30/duckdb:duckdb 275853535 276148295 1.00
clickbench_q31/duckdb:duckdb 365175923 368079959 0.99
clickbench_q32/duckdb:duckdb 1106882212 1116799428 0.99
clickbench_q33/duckdb:duckdb 1127067444 1113520637 1.01
clickbench_q34/duckdb:duckdb 1194650478 1196747784 1.00
clickbench_q35/duckdb:duckdb 295213946 298741203 0.99
clickbench_q36/duckdb:duckdb 49840535 48778039 1.02
clickbench_q37/duckdb:duckdb 28400593 28848730 0.98
clickbench_q38/duckdb:duckdb 32751488 34548489 0.95
clickbench_q39/duckdb:duckdb 79075073 84182819 0.94
clickbench_q40/duckdb:duckdb 27467158 27802363 0.99
clickbench_q41/duckdb:duckdb 27014833 27180570 0.99
clickbench_q42/duckdb:duckdb 29002105 29713563 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +1.1% -4.0% +5.4% +728.6% ➖ noise
0 duckdb:duckdb -1.5% -4.0% +2.7% +266.1% ➖ noise
0 duckdb:vortex-file-compressed -18.4% -4.0% -15.0% +444.9% ➖ noise
1 datafusion:vortex-file-compressed +4.9% +1.4% +3.4% +27.0% ➖ noise
1 duckdb:duckdb -0.1% +1.4% -1.5% +41.2% ➖ noise
1 duckdb:vortex-file-compressed +1.7% +1.4% +0.3% +32.4% ➖ noise
2 datafusion:vortex-file-compressed +3.4% -3.7% +7.4% +17.2% ➖ noise
2 duckdb:duckdb -0.3% -3.7% +3.6% +28.2% ➖ noise
2 duckdb:vortex-file-compressed -0.2% -3.7% +3.7% +11.8% ➖ noise
3 datafusion:vortex-file-compressed +0.3% -2.2% +2.5% +142.3% ➖ noise
3 duckdb:duckdb +0.8% -2.2% +3.1% +36.4% ➖ noise
3 duckdb:vortex-file-compressed -3.7% -2.2% -1.5% +66.3% ➖ noise
4 datafusion:vortex-file-compressed -0.8% -2.4% +1.6% +10.0% ➖ noise
4 duckdb:duckdb -3.4% -2.4% -1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.4% -2.4% +1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.3% +1.2% -0.9% +10.0% ➖ noise
5 duckdb:duckdb -2.6% +1.2% -3.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.2% +1.2% -1.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.2% -1.9% +1.8% +51.5% ➖ noise
6 duckdb:duckdb -5.6% -1.9% -3.7% +15.7% ➖ noise
6 duckdb:vortex-file-compressed -3.3% -1.9% -1.4% +16.7% ➖ noise
7 datafusion:vortex-file-compressed -1.9% -1.3% -0.6% +11.9% ➖ noise
7 duckdb:duckdb -1.8% -1.3% -0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.5% -1.3% -4.2% +11.4% ➖ noise
8 datafusion:vortex-file-compressed -0.6% +1.3% -1.8% +10.0% ➖ noise
8 duckdb:duckdb -3.1% +1.3% -4.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.0% +1.3% -0.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.4% -0.2% +3.7% +10.0% ➖ noise
9 duckdb:duckdb -1.4% -0.2% -1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.0% -0.2% -0.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.6% -0.2% -1.5% +10.0% ➖ noise
10 duckdb:duckdb -2.5% -0.2% -2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.7% -0.2% -2.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.0% -1.1% -2.0% +10.0% ➖ noise
11 duckdb:duckdb -0.5% -1.1% +0.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.4% -1.1% +0.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.1% -1.2% +2.3% +10.0% ➖ noise
12 duckdb:duckdb -1.0% -1.2% +0.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -2.0% -1.2% -0.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.4% -3.2% +3.8% +10.0% ➖ noise
13 duckdb:duckdb -2.5% -3.2% +0.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.1% -3.2% +2.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.6% -0.2% +0.8% +10.0% ➖ noise
14 duckdb:duckdb -3.9% -0.2% -3.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.8% -0.2% -0.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.0% -0.4% +0.5% +10.0% ➖ noise
15 duckdb:duckdb -1.8% -0.4% -1.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +2.5% -0.4% +2.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.2% -0.5% +0.4% +10.0% ➖ noise
16 duckdb:duckdb -0.5% -0.5% +0.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.8% -0.5% +1.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.5% +0.4% +0.1% +10.0% ➖ noise
17 duckdb:duckdb -1.2% +0.4% -1.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.2% +0.4% -0.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.1% -2.3% +2.5% +10.0% ➖ noise
18 duckdb:duckdb -2.8% -2.3% -0.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.6% -2.3% +3.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.3% -1.6% -2.8% +28.0% ➖ noise
19 duckdb:duckdb +0.3% -1.6% +1.9% +25.0% ➖ noise
19 duckdb:vortex-file-compressed -0.2% -1.6% +1.3% +19.9% ➖ noise
20 datafusion:vortex-file-compressed -0.5% -1.4% +0.9% +205.6% ➖ noise
20 duckdb:duckdb -0.0% -1.4% +1.4% +62.3% ➖ noise
20 duckdb:vortex-file-compressed -0.3% -1.4% +1.1% +57.1% ➖ noise
21 datafusion:vortex-file-compressed -1.9% -0.5% -1.5% +10.0% ➖ noise
21 duckdb:duckdb -0.3% -0.5% +0.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +2.0% -0.5% +2.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.6% -1.4% +2.0% +14.7% ➖ noise
22 duckdb:duckdb -5.1% -1.4% -3.8% +29.9% ➖ noise
22 duckdb:vortex-file-compressed +10.9% -1.4% +12.4% +14.8% ➖ noise
23 datafusion:vortex-file-compressed -1.2% -0.8% -0.4% +53.9% ➖ noise
23 duckdb:duckdb -7.4% -0.8% -6.7% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -5.3% -0.8% -4.6% +19.5% ➖ noise
24 datafusion:vortex-file-compressed -0.8% +2.1% -2.8% +10.0% ➖ noise
24 duckdb:duckdb +1.2% +2.1% -0.9% +32.2% ➖ noise
24 duckdb:vortex-file-compressed +1.1% +2.1% -0.9% +25.8% ➖ noise
25 datafusion:vortex-file-compressed +2.5% -2.0% +4.6% +10.0% ➖ noise
25 duckdb:duckdb -0.3% -2.0% +1.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +9.1% -2.0% +11.3% +12.2% ➖ noise
26 datafusion:vortex-file-compressed +0.7% -0.5% +1.3% +10.0% ➖ noise
26 duckdb:duckdb -2.5% -0.5% -2.0% +11.1% ➖ noise
26 duckdb:vortex-file-compressed +4.6% -0.5% +5.2% +17.3% ➖ noise
27 datafusion:vortex-file-compressed -3.0% -0.5% -2.5% +10.0% ➖ noise
27 duckdb:duckdb +0.9% -0.5% +1.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +1.7% -0.5% +2.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.3% -1.4% +0.1% +10.0% ➖ noise
28 duckdb:duckdb -0.1% -1.4% +1.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.5% -1.4% +1.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +1.7% +0.2% +1.4% +10.0% ➖ noise
29 duckdb:duckdb -0.4% +0.2% -0.7% +10.7% ➖ noise
29 duckdb:vortex-file-compressed +6.6% +0.2% +6.3% +18.2% ➖ noise
30 datafusion:vortex-file-compressed -0.2% +0.5% -0.7% +10.0% ➖ noise
30 duckdb:duckdb -0.1% +0.5% -0.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.3% +0.5% -1.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.5% -0.4% -0.1% +10.0% ➖ noise
31 duckdb:duckdb -0.8% -0.4% -0.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -2.6% -0.4% -2.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +0.4% -0.3% +0.6% +10.0% ➖ noise
32 duckdb:duckdb -0.9% -0.3% -0.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -1.1% -0.3% -0.9% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.8% +0.5% +0.3% +10.0% ➖ noise
33 duckdb:duckdb +1.2% +0.5% +0.7% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.6% +0.5% -4.1% +20.4% ➖ noise
34 datafusion:vortex-file-compressed +1.0% +0.9% +0.1% +10.0% ➖ noise
34 duckdb:duckdb -0.2% +0.9% -1.1% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +0.1% +0.9% -0.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +1.5% +1.2% +0.3% +10.0% ➖ noise
35 duckdb:duckdb -1.2% +1.2% -2.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.4% +1.2% -1.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.8% +2.7% -0.9% +10.0% ➖ noise
36 duckdb:duckdb +2.2% +2.7% -0.5% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +1.8% +2.7% -0.9% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +0.6% -1.3% +1.9% +10.0% ➖ noise
37 duckdb:duckdb -1.6% -1.3% -0.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +5.1% -1.3% +6.5% +24.4% ➖ noise
38 datafusion:vortex-file-compressed +2.4% -1.6% +4.0% +10.0% ➖ noise
38 duckdb:duckdb -5.2% -1.6% -3.7% +19.8% ➖ noise
38 duckdb:vortex-file-compressed +0.3% -1.6% +1.9% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +1.5% +2.4% -0.8% +10.0% ➖ noise
39 duckdb:duckdb -6.1% +2.4% -8.2% +11.4% ➖ noise
39 duckdb:vortex-file-compressed -1.9% +2.4% -4.1% +10.5% ➖ noise
40 datafusion:vortex-file-compressed +1.5% +1.2% +0.3% +10.3% ➖ noise
40 duckdb:duckdb -1.2% +1.2% -2.4% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -2.3% +1.2% -3.4% +14.1% ➖ noise
41 datafusion:vortex-file-compressed +2.4% +0.4% +1.9% +10.0% ➖ noise
41 duckdb:duckdb -0.6% +0.4% -1.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +12.7% +0.4% +12.2% +11.5% 🚨 regression
42 datafusion:vortex-file-compressed -1.2% -2.8% +1.6% +11.8% ➖ noise
42 duckdb:duckdb -2.4% -2.8% +0.4% +12.1% ➖ noise
42 duckdb:vortex-file-compressed +3.0% -2.8% +5.9% +17.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (201 files changed, -0.0% overall, 0↑ 201↓)
File Scale Format Base HEAD Change %
hits_51.vortex 1.0 vortex-file-compressed 428.84 MB 428.84 MB 32 B -0.0%
hits_54.vortex 1.0 vortex-file-compressed 361.83 MB 361.83 MB 32 B -0.0%
hits_43.vortex 1.0 vortex-file-compressed 305.71 MB 305.71 MB 32 B -0.0%
hits_41.vortex 1.0 vortex-file-compressed 300.49 MB 300.49 MB 32 B -0.0%
hits_42.vortex 1.0 vortex-file-compressed 298.79 MB 298.79 MB 32 B -0.0%
hits_89.vortex 1.0 vortex-file-compressed 266.01 MB 266.01 MB 32 B -0.0%
hits_67.vortex 1.0 vortex-file-compressed 265.94 MB 265.94 MB 32 B -0.0%
hits_50.vortex 1.0 vortex-file-compressed 255.24 MB 255.24 MB 32 B -0.0%
hits_55.vortex 1.0 vortex-file-compressed 251.56 MB 251.56 MB 32 B -0.0%
hits_44.vortex 1.0 vortex-file-compressed 243.64 MB 243.64 MB 32 B -0.0%
hits_2.vortex 1.0 vortex-file-compressed 241.46 MB 241.46 MB 32 B -0.0%
hits_78.vortex 1.0 vortex-file-compressed 238.59 MB 238.59 MB 32 B -0.0%
hits_65.vortex 1.0 vortex-file-compressed 238.05 MB 238.05 MB 32 B -0.0%
hits_87.vortex 1.0 vortex-file-compressed 221.68 MB 221.68 MB 32 B -0.0%
hits_77.vortex 1.0 vortex-file-compressed 218.96 MB 218.96 MB 32 B -0.0%
hits_79.vortex 1.0 vortex-file-compressed 204.16 MB 204.16 MB 32 B -0.0%
hits_90.vortex 1.0 vortex-file-compressed 204.12 MB 204.12 MB 32 B -0.0%
hits_92.vortex 1.0 vortex-file-compressed 196.47 MB 196.47 MB 32 B -0.0%
hits_3.vortex 1.0 vortex-file-compressed 193.11 MB 193.11 MB 32 B -0.0%
hits_94.vortex 1.0 vortex-file-compressed 185.12 MB 185.12 MB 32 B -0.0%
hits_1.vortex 1.0 vortex-file-compressed 181.16 MB 181.16 MB 32 B -0.0%
hits_96.vortex 1.0 vortex-file-compressed 180.76 MB 180.76 MB 32 B -0.0%
hits_27.vortex 1.0 vortex-file-compressed 174.61 MB 174.61 MB 32 B -0.0%
hits_68.vortex 1.0 vortex-file-compressed 172.16 MB 172.16 MB 32 B -0.0%
hits_43.vortex 1.0 vortex-compact 168.91 MB 168.91 MB 32 B -0.0%
hits_51.vortex 1.0 vortex-compact 167.81 MB 167.81 MB 32 B -0.0%
hits_28.vortex 1.0 vortex-file-compressed 167.55 MB 167.55 MB 32 B -0.0%
hits_41.vortex 1.0 vortex-compact 165.78 MB 165.78 MB 32 B -0.0%
hits_42.vortex 1.0 vortex-compact 164.22 MB 164.22 MB 32 B -0.0%
hits_56.vortex 1.0 vortex-file-compressed 163.76 MB 163.76 MB 32 B -0.0%
hits_99.vortex 1.0 vortex-file-compressed 158.88 MB 158.88 MB 32 B -0.0%
hits_57.vortex 1.0 vortex-file-compressed 158.37 MB 158.37 MB 32 B -0.0%
hits_74.vortex 1.0 vortex-file-compressed 152.12 MB 152.12 MB 32 B -0.0%
hits_98.vortex 1.0 vortex-file-compressed 150.55 MB 150.55 MB 32 B -0.0%
hits_62.vortex 1.0 vortex-file-compressed 148.36 MB 148.36 MB 32 B -0.0%
hits_69.vortex 1.0 vortex-file-compressed 147.61 MB 147.61 MB 32 B -0.0%
hits_45.vortex 1.0 vortex-file-compressed 145.48 MB 145.48 MB 32 B -0.0%
hits_84.vortex 1.0 vortex-file-compressed 145.05 MB 145.05 MB 32 B -0.0%
hits_26.vortex 1.0 vortex-file-compressed 144.05 MB 144.05 MB 32 B -0.0%
hits_40.vortex 1.0 vortex-file-compressed 142.99 MB 142.99 MB 32 B -0.0%
hits_76.vortex 1.0 vortex-file-compressed 140.05 MB 140.05 MB 32 B -0.0%
hits_4.vortex 1.0 vortex-file-compressed 138.86 MB 138.86 MB 32 B -0.0%
hits_35.vortex 1.0 vortex-file-compressed 138.81 MB 138.81 MB 32 B -0.0%
hits_88.vortex 1.0 vortex-file-compressed 137.34 MB 137.34 MB 32 B -0.0%
hits_25.vortex 1.0 vortex-file-compressed 137.01 MB 137.01 MB 32 B -0.0%
hits_14.vortex 1.0 vortex-file-compressed 135.14 MB 135.14 MB 32 B -0.0%
hits_44.vortex 1.0 vortex-compact 132.46 MB 132.46 MB 32 B -0.0%
hits_73.vortex 1.0 vortex-file-compressed 131.83 MB 131.83 MB 32 B -0.0%
hits_97.vortex 1.0 vortex-file-compressed 130.96 MB 130.96 MB 32 B -0.0%
hits_65.vortex 1.0 vortex-compact 129.95 MB 129.95 MB 32 B -0.0%
hits_2.vortex 1.0 vortex-compact 129.36 MB 129.36 MB 32 B -0.0%
hits_81.vortex 1.0 vortex-file-compressed 126.55 MB 126.55 MB 32 B -0.0%
hits_71.vortex 1.0 vortex-file-compressed 126.41 MB 126.41 MB 32 B -0.0%
hits_18.vortex 1.0 vortex-file-compressed 126.06 MB 126.06 MB 32 B -0.0%
hits_12.vortex 1.0 vortex-file-compressed 125.34 MB 125.34 MB 32 B -0.0%
hits_80.vortex 1.0 vortex-file-compressed 124.24 MB 124.24 MB 32 B -0.0%
hits_9.vortex 1.0 vortex-file-compressed 124.22 MB 124.22 MB 32 B -0.0%
hits_7.vortex 1.0 vortex-file-compressed 123.82 MB 123.82 MB 32 B -0.0%
hits_13.vortex 1.0 vortex-file-compressed 123.20 MB 123.20 MB 32 B -0.0%
hits_6.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB 32 B -0.0%
hits_8.vortex 1.0 vortex-file-compressed 122.86 MB 122.86 MB 32 B -0.0%
hits_82.vortex 1.0 vortex-file-compressed 122.77 MB 122.77 MB 32 B -0.0%
hits_5.vortex 1.0 vortex-file-compressed 122.64 MB 122.64 MB 32 B -0.0%
hits_59.vortex 1.0 vortex-file-compressed 121.84 MB 121.84 MB 32 B -0.0%
hits_60.vortex 1.0 vortex-file-compressed 121.19 MB 121.19 MB 32 B -0.0%
hits_52.vortex 1.0 vortex-file-compressed 120.78 MB 120.78 MB 32 B -0.0%
hits_87.vortex 1.0 vortex-compact 119.04 MB 119.04 MB 32 B -0.0%
hits_38.vortex 1.0 vortex-file-compressed 118.43 MB 118.43 MB 32 B -0.0%
hits_77.vortex 1.0 vortex-compact 118.11 MB 118.11 MB 32 B -0.0%
hits_54.vortex 1.0 vortex-compact 117.66 MB 117.66 MB 32 B -0.0%
hits_91.vortex 1.0 vortex-file-compressed 116.23 MB 116.23 MB 32 B -0.0%
hits_70.vortex 1.0 vortex-file-compressed 115.14 MB 115.14 MB 32 B -0.0%
hits_61.vortex 1.0 vortex-file-compressed 114.43 MB 114.43 MB 32 B -0.0%
hits_95.vortex 1.0 vortex-file-compressed 114.33 MB 114.33 MB 32 B -0.0%
hits_67.vortex 1.0 vortex-compact 114.05 MB 114.05 MB 32 B -0.0%
hits_58.vortex 1.0 vortex-file-compressed 113.78 MB 113.78 MB 32 B -0.0%
hits_50.vortex 1.0 vortex-compact 113.12 MB 113.12 MB 32 B -0.0%
hits_89.vortex 1.0 vortex-compact 112.82 MB 112.82 MB 32 B -0.0%
hits_0.vortex 1.0 vortex-file-compressed 112.17 MB 112.17 MB 32 B -0.0%
hits_34.vortex 1.0 vortex-file-compressed 111.68 MB 111.68 MB 32 B -0.0%
hits_93.vortex 1.0 vortex-file-compressed 107.66 MB 107.66 MB 32 B -0.0%
hits_85.vortex 1.0 vortex-file-compressed 106.37 MB 106.37 MB 32 B -0.0%
hits_66.vortex 1.0 vortex-file-compressed 105.34 MB 105.34 MB 32 B -0.0%
hits_31.vortex 1.0 vortex-file-compressed 104.39 MB 104.39 MB 32 B -0.0%
hits_30.vortex 1.0 vortex-file-compressed 104.00 MB 104.00 MB 32 B -0.0%
hits_83.vortex 1.0 vortex-file-compressed 103.72 MB 103.72 MB 32 B -0.0%
hits_17.vortex 1.0 vortex-file-compressed 103.64 MB 103.64 MB 32 B -0.0%
hits_21.vortex 1.0 vortex-file-compressed 101.28 MB 101.28 MB 32 B -0.0%
hits_53.vortex 1.0 vortex-file-compressed 98.26 MB 98.26 MB 32 B -0.0%
hits_78.vortex 1.0 vortex-compact 97.87 MB 97.87 MB 32 B -0.0%
hits_37.vortex 1.0 vortex-file-compressed 97.54 MB 97.54 MB 32 B -0.0%
hits_15.vortex 1.0 vortex-file-compressed 97.01 MB 97.01 MB 32 B -0.0%
hits_72.vortex 1.0 vortex-file-compressed 96.27 MB 96.27 MB 32 B -0.0%
hits_11.vortex 1.0 vortex-file-compressed 96.07 MB 96.07 MB 32 B -0.0%
hits_64.vortex 1.0 vortex-file-compressed 95.27 MB 95.27 MB 32 B -0.0%
hits_92.vortex 1.0 vortex-compact 94.27 MB 94.27 MB 32 B -0.0%
hits_3.vortex 1.0 vortex-compact 94.23 MB 94.23 MB 32 B -0.0%
hits_39.vortex 1.0 vortex-file-compressed 94.06 MB 94.06 MB 32 B -0.0%
hits_55.vortex 1.0 vortex-compact 93.77 MB 93.77 MB 32 B -0.0%
hits_96.vortex 1.0 vortex-compact 91.08 MB 91.08 MB 32 B -0.0%
hits_94.vortex 1.0 vortex-compact 90.63 MB 90.63 MB 32 B -0.0%
hits_1.vortex 1.0 vortex-compact 90.34 MB 90.34 MB 32 B -0.0%
hits_49.vortex 1.0 vortex-file-compressed 88.67 MB 88.67 MB 32 B -0.0%
hits_16.vortex 1.0 vortex-file-compressed 87.59 MB 87.59 MB 32 B -0.0%
hits_79.vortex 1.0 vortex-compact 85.70 MB 85.70 MB 32 B -0.0%
hits_57.vortex 1.0 vortex-compact 83.54 MB 83.54 MB 32 B -0.0%
hits_19.vortex 1.0 vortex-file-compressed 82.10 MB 82.10 MB 32 B -0.0%
hits_90.vortex 1.0 vortex-compact 81.86 MB 81.86 MB 32 B -0.0%
hits_10.vortex 1.0 vortex-file-compressed 81.76 MB 81.76 MB 32 B -0.0%
hits_86.vortex 1.0 vortex-file-compressed 81.40 MB 81.40 MB 32 B -0.0%
hits_22.vortex 1.0 vortex-file-compressed 81.17 MB 81.17 MB 32 B -0.0%
hits_69.vortex 1.0 vortex-compact 81.02 MB 81.02 MB 32 B -0.0%
hits_63.vortex 1.0 vortex-file-compressed 80.62 MB 80.62 MB 32 B -0.0%
hits_23.vortex 1.0 vortex-file-compressed 80.37 MB 80.37 MB 32 B -0.0%
hits_46.vortex 1.0 vortex-file-compressed 80.32 MB 80.32 MB 32 B -0.0%
hits_36.vortex 1.0 vortex-file-compressed 80.27 MB 80.27 MB 32 B -0.0%
hits_24.vortex 1.0 vortex-file-compressed 79.71 MB 79.71 MB 32 B -0.0%
hits_56.vortex 1.0 vortex-compact 77.87 MB 77.87 MB 32 B -0.0%
hits_99.vortex 1.0 vortex-compact 77.31 MB 77.31 MB 32 B -0.0%
hits_32.vortex 1.0 vortex-file-compressed 77.12 MB 77.12 MB 32 B -0.0%
hits_76.vortex 1.0 vortex-compact 76.44 MB 76.44 MB 32 B -0.0%
hits_45.vortex 1.0 vortex-compact 76.07 MB 76.07 MB 32 B -0.0%
hits_68.vortex 1.0 vortex-compact 75.99 MB 75.99 MB 32 B -0.0%
hits_40.vortex 1.0 vortex-compact 75.92 MB 75.92 MB 32 B -0.0%
hits_35.vortex 1.0 vortex-compact 75.11 MB 75.11 MB 32 B -0.0%
hits_62.vortex 1.0 vortex-compact 74.26 MB 74.26 MB 32 B -0.0%
hits_75.vortex 1.0 vortex-file-compressed 74.18 MB 74.18 MB 32 B -0.0%
hits_14.vortex 1.0 vortex-compact 73.75 MB 73.75 MB 32 B -0.0%
hits_88.vortex 1.0 vortex-compact 73.31 MB 73.31 MB 32 B -0.0%
hits_84.vortex 1.0 vortex-compact 73.14 MB 73.14 MB 32 B -0.0%
hits_25.vortex 1.0 vortex-compact 73.14 MB 73.14 MB 32 B -0.0%
hits_98.vortex 1.0 vortex-compact 72.77 MB 72.77 MB 32 B -0.0%
hits_4.vortex 1.0 vortex-compact 71.81 MB 71.81 MB 32 B -0.0%
hits_74.vortex 1.0 vortex-compact 71.62 MB 71.62 MB 32 B -0.0%
hits_26.vortex 1.0 vortex-compact 70.89 MB 70.89 MB 32 B -0.0%
hits_28.vortex 1.0 vortex-compact 70.27 MB 70.27 MB 32 B -0.0%
hits_73.vortex 1.0 vortex-compact 70.04 MB 70.04 MB 32 B -0.0%
hits_27.vortex 1.0 vortex-compact 69.88 MB 69.88 MB 32 B -0.0%
hits_71.vortex 1.0 vortex-compact 69.29 MB 69.29 MB 32 B -0.0%
hits_12.vortex 1.0 vortex-compact 69.27 MB 69.27 MB 32 B -0.0%
hits_97.vortex 1.0 vortex-compact 69.16 MB 69.16 MB 32 B -0.0%
hits_80.vortex 1.0 vortex-compact 68.07 MB 68.07 MB 32 B -0.0%
hits_13.vortex 1.0 vortex-compact 67.96 MB 67.96 MB 32 B -0.0%
hits_20.vortex 1.0 vortex-file-compressed 67.53 MB 67.53 MB 32 B -0.0%
hits_82.vortex 1.0 vortex-compact 66.89 MB 66.89 MB 32 B -0.0%
hits_59.vortex 1.0 vortex-compact 66.30 MB 66.30 MB 32 B -0.0%
hits_9.vortex 1.0 vortex-compact 65.67 MB 65.67 MB 32 B -0.0%
hits_29.vortex 1.0 vortex-file-compressed 65.47 MB 65.47 MB 32 B -0.0%
hits_81.vortex 1.0 vortex-compact 65.45 MB 65.45 MB 32 B -0.0%
hits_60.vortex 1.0 vortex-compact 64.33 MB 64.33 MB 32 B -0.0%
hits_18.vortex 1.0 vortex-compact 64.28 MB 64.28 MB 32 B -0.0%
hits_7.vortex 1.0 vortex-compact 63.80 MB 63.80 MB 32 B -0.0%
hits_52.vortex 1.0 vortex-compact 63.73 MB 63.73 MB 32 B -0.0%
hits_6.vortex 1.0 vortex-compact 63.16 MB 63.16 MB 32 B -0.0%
hits_38.vortex 1.0 vortex-compact 63.10 MB 63.10 MB 32 B -0.0%
hits_33.vortex 1.0 vortex-file-compressed 62.97 MB 62.97 MB 32 B -0.0%
hits_5.vortex 1.0 vortex-compact 62.90 MB 62.90 MB 32 B -0.0%
hits_8.vortex 1.0 vortex-compact 62.89 MB 62.89 MB 32 B -0.0%
hits_70.vortex 1.0 vortex-compact 61.29 MB 61.29 MB 32 B -0.0%
hits_91.vortex 1.0 vortex-compact 60.94 MB 60.94 MB 32 B -0.0%
hits_58.vortex 1.0 vortex-compact 60.41 MB 60.41 MB 32 B -0.0%
hits_53.vortex 1.0 vortex-compact 59.09 MB 59.09 MB 32 B -0.0%
hits_93.vortex 1.0 vortex-compact 58.90 MB 58.90 MB 32 B -0.0%
hits_30.vortex 1.0 vortex-compact 58.69 MB 58.69 MB 32 B -0.0%
hits_0.vortex 1.0 vortex-compact 58.66 MB 58.66 MB 32 B -0.0%
hits_17.vortex 1.0 vortex-compact 58.32 MB 58.32 MB 32 B -0.0%
hits_34.vortex 1.0 vortex-compact 58.26 MB 58.26 MB 32 B -0.0%
hits_95.vortex 1.0 vortex-compact 57.75 MB 57.75 MB 32 B -0.0%
hits_61.vortex 1.0 vortex-compact 57.66 MB 57.66 MB 32 B -0.0%
hits_31.vortex 1.0 vortex-compact 55.56 MB 55.56 MB 32 B -0.0%
hits_11.vortex 1.0 vortex-compact 54.35 MB 54.35 MB 32 B -0.0%
hits_64.vortex 1.0 vortex-compact 53.91 MB 53.91 MB 32 B -0.0%
hits_37.vortex 1.0 vortex-compact 53.83 MB 53.83 MB 32 B -0.0%
hits_66.vortex 1.0 vortex-compact 53.49 MB 53.49 MB 32 B -0.0%
hits_85.vortex 1.0 vortex-compact 52.73 MB 52.73 MB 32 B -0.0%
hits_83.vortex 1.0 vortex-compact 52.57 MB 52.57 MB 32 B -0.0%
hits_72.vortex 1.0 vortex-compact 51.79 MB 51.79 MB 32 B -0.0%
hits_21.vortex 1.0 vortex-compact 51.60 MB 51.60 MB 32 B -0.0%
hits_49.vortex 1.0 vortex-compact 50.53 MB 50.53 MB 32 B -0.0%
hits_39.vortex 1.0 vortex-compact 49.82 MB 49.82 MB 32 B -0.0%
hits_36.vortex 1.0 vortex-compact 48.99 MB 48.99 MB 32 B -0.0%
hits_10.vortex 1.0 vortex-compact 48.86 MB 48.86 MB 32 B -0.0%
hits_16.vortex 1.0 vortex-compact 48.30 MB 48.30 MB 32 B -0.0%
hits_86.vortex 1.0 vortex-compact 48.25 MB 48.25 MB 32 B -0.0%
hits_15.vortex 1.0 vortex-compact 48.14 MB 48.14 MB 32 B -0.0%
hits_63.vortex 1.0 vortex-compact 46.10 MB 46.10 MB 32 B -0.0%
hits_19.vortex 1.0 vortex-compact 44.88 MB 44.88 MB 32 B -0.0%
hits_22.vortex 1.0 vortex-compact 44.74 MB 44.74 MB 32 B -0.0%
hits_23.vortex 1.0 vortex-compact 44.17 MB 44.17 MB 32 B -0.0%
hits_32.vortex 1.0 vortex-compact 44.13 MB 44.13 MB 32 B -0.0%
hits_24.vortex 1.0 vortex-compact 43.63 MB 43.63 MB 32 B -0.0%
hits_75.vortex 1.0 vortex-compact 43.63 MB 43.63 MB 32 B -0.0%
hits_46.vortex 1.0 vortex-compact 41.92 MB 41.92 MB 32 B -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.86 MB 41.86 MB 32 B -0.0%
hits_20.vortex 1.0 vortex-compact 38.14 MB 38.14 MB 32 B -0.0%
hits_29.vortex 1.0 vortex-compact 36.61 MB 36.61 MB 32 B -0.0%
hits_33.vortex 1.0 vortex-compact 35.95 MB 35.95 MB 32 B -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.53 MB 28.53 MB 32 B -0.0%
hits_47.vortex 1.0 vortex-compact 18.25 MB 18.25 MB 32 B -0.0%
hits_48.vortex 1.0 vortex-compact 17.32 MB 17.32 MB 32 B -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.5%
Vortex (geomean): 0.992x ➖
Parquet (geomean): 1.049x ➖
Shifts: Parquet (control) +4.9% · Median polish +2.2%


datafusion / vortex-file-compressed (0.995x ➖, 2↑ 4↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 282394309 267536250 1.06
tpch_q02/datafusion:vortex-file-compressed 492617556 698992128 0.70
tpch_q03/datafusion:vortex-file-compressed 454448866 512204035 0.89
tpch_q04/datafusion:vortex-file-compressed 245025606 287339622 0.85
tpch_q05/datafusion:vortex-file-compressed 🚨 892791352 516054288 1.73
tpch_q06/datafusion:vortex-file-compressed 369757355 372772297 0.99
tpch_q07/datafusion:vortex-file-compressed 419212606 596064055 0.70
tpch_q08/datafusion:vortex-file-compressed 🚀 761541005 1249941282 0.61
tpch_q09/datafusion:vortex-file-compressed 🚀 383412672 685904494 0.56
tpch_q10/datafusion:vortex-file-compressed 518577536 577710061 0.90
tpch_q11/datafusion:vortex-file-compressed 373202436 439407152 0.85
tpch_q12/datafusion:vortex-file-compressed 483783883 487935827 0.99
tpch_q13/datafusion:vortex-file-compressed 🚨 240753800 140902976 1.71
tpch_q14/datafusion:vortex-file-compressed 288084950 307659297 0.94
tpch_q15/datafusion:vortex-file-compressed 536980486 543139074 0.99
tpch_q16/datafusion:vortex-file-compressed 231870951 235370558 0.99
tpch_q17/datafusion:vortex-file-compressed 514783197 435734736 1.18
tpch_q18/datafusion:vortex-file-compressed 466784055 396971890 1.18
tpch_q19/datafusion:vortex-file-compressed 🚨 735546650 530626771 1.39
tpch_q20/datafusion:vortex-file-compressed 454182026 417394207 1.09
tpch_q21/datafusion:vortex-file-compressed 648470659 574664611 1.13
tpch_q22/datafusion:vortex-file-compressed 🚨 153444827 111579369 1.38
datafusion / vortex-compact (0.878x ➖, 3↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 266493605 305122784 0.87
tpch_q02/datafusion:vortex-compact 525255004 475195151 1.11
tpch_q03/datafusion:vortex-compact 386007485 458089677 0.84
tpch_q04/datafusion:vortex-compact 220268457 212773495 1.04
tpch_q05/datafusion:vortex-compact 413249622 457171985 0.90
tpch_q06/datafusion:vortex-compact 362375356 458514669 0.79
tpch_q07/datafusion:vortex-compact 🚀 482261290 722984147 0.67
tpch_q08/datafusion:vortex-compact 532444383 626966427 0.85
tpch_q09/datafusion:vortex-compact 417826302 434787814 0.96
tpch_q10/datafusion:vortex-compact 465558349 566340895 0.82
tpch_q11/datafusion:vortex-compact 294888904 404114602 0.73
tpch_q12/datafusion:vortex-compact 🚀 331026409 605700328 0.55
tpch_q13/datafusion:vortex-compact 🚀 138678979 198591267 0.70
tpch_q14/datafusion:vortex-compact 233105173 248624403 0.94
tpch_q15/datafusion:vortex-compact 430198125 391750026 1.10
tpch_q16/datafusion:vortex-compact 192807086 193794169 0.99
tpch_q17/datafusion:vortex-compact 454429624 437244816 1.04
tpch_q18/datafusion:vortex-compact 330061977 394742494 0.84
tpch_q19/datafusion:vortex-compact 623227075 702540974 0.89
tpch_q20/datafusion:vortex-compact 449092484 445871773 1.01
tpch_q21/datafusion:vortex-compact 626457344 629061064 1.00
tpch_q22/datafusion:vortex-compact 141614643 145581552 0.97
datafusion / parquet (0.995x ➖, 0↑ 2↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 201980420 254061559 0.80
tpch_q02/datafusion:parquet 438250382 424281693 1.03
tpch_q03/datafusion:parquet 302788060 337434819 0.90
tpch_q04/datafusion:parquet 154560836 173211506 0.89
tpch_q05/datafusion:parquet 447860382 458582685 0.98
tpch_q06/datafusion:parquet 149605716 182488092 0.82
tpch_q07/datafusion:parquet 432976074 466333440 0.93
tpch_q08/datafusion:parquet 558071531 625477502 0.89
tpch_q09/datafusion:parquet 487622650 529785061 0.92
tpch_q10/datafusion:parquet 534151244 500393024 1.07
tpch_q11/datafusion:parquet 339000829 334469919 1.01
tpch_q12/datafusion:parquet 228542721 265353448 0.86
tpch_q13/datafusion:parquet 444705752 434047587 1.02
tpch_q14/datafusion:parquet 202656728 266248306 0.76
tpch_q15/datafusion:parquet 396822363 410728559 0.97
tpch_q16/datafusion:parquet 200228228 163446291 1.23
tpch_q17/datafusion:parquet 550502584 508618175 1.08
tpch_q18/datafusion:parquet 🚨 829693633 629265443 1.32
tpch_q19/datafusion:parquet 567069431 633698372 0.89
tpch_q20/datafusion:parquet 460173489 397307934 1.16
tpch_q21/datafusion:parquet 695288849 603144059 1.15
tpch_q22/datafusion:parquet 🚨 179152495 116518070 1.54
duckdb / vortex-file-compressed (1.031x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 275306798 273846142 1.01
tpch_q02/duckdb:vortex-file-compressed 1085191206 1118328167 0.97
tpch_q03/duckdb:vortex-file-compressed 793057307 741701878 1.07
tpch_q04/duckdb:vortex-file-compressed 440723318 514081869 0.86
tpch_q05/duckdb:vortex-file-compressed 953429318 825300705 1.16
tpch_q06/duckdb:vortex-file-compressed 413423178 394230584 1.05
tpch_q07/duckdb:vortex-file-compressed 1009837111 926009180 1.09
tpch_q08/duckdb:vortex-file-compressed 1043873569 1071123899 0.97
tpch_q09/duckdb:vortex-file-compressed 1067338666 957675082 1.11
tpch_q10/duckdb:vortex-file-compressed 804071262 768004761 1.05
tpch_q11/duckdb:vortex-file-compressed 533470647 496083990 1.08
tpch_q12/duckdb:vortex-file-compressed 680117871 718782999 0.95
tpch_q13/duckdb:vortex-file-compressed 490422695 476977385 1.03
tpch_q14/duckdb:vortex-file-compressed 428980530 446278655 0.96
tpch_q15/duckdb:vortex-file-compressed 297098939 290803759 1.02
tpch_q16/duckdb:vortex-file-compressed 392329377 320199905 1.23
tpch_q17/duckdb:vortex-file-compressed 704711009 793370773 0.89
tpch_q18/duckdb:vortex-file-compressed 563650736 561084231 1.00
tpch_q19/duckdb:vortex-file-compressed 528840237 499973835 1.06
tpch_q20/duckdb:vortex-file-compressed 840851808 791471765 1.06
tpch_q21/duckdb:vortex-file-compressed 1128426282 1069610616 1.05
tpch_q22/duckdb:vortex-file-compressed 305448369 279577188 1.09
duckdb / vortex-compact (1.075x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 292945248 297790715 0.98
tpch_q02/duckdb:vortex-compact 1025671287 920505582 1.11
tpch_q03/duckdb:vortex-compact 685710429 668804138 1.03
tpch_q04/duckdb:vortex-compact 439686631 431983791 1.02
tpch_q05/duckdb:vortex-compact 813569854 718096781 1.13
tpch_q06/duckdb:vortex-compact 373651207 345407898 1.08
tpch_q07/duckdb:vortex-compact 1015163749 932734618 1.09
tpch_q08/duckdb:vortex-compact 1047767522 903090033 1.16
tpch_q09/duckdb:vortex-compact 1024680734 958172191 1.07
tpch_q10/duckdb:vortex-compact 781832199 711507072 1.10
tpch_q11/duckdb:vortex-compact 518862596 478929798 1.08
tpch_q12/duckdb:vortex-compact 688832355 593373668 1.16
tpch_q13/duckdb:vortex-compact 482845553 439517249 1.10
tpch_q14/duckdb:vortex-compact 431597487 465856992 0.93
tpch_q15/duckdb:vortex-compact 346471797 309023577 1.12
tpch_q16/duckdb:vortex-compact 348480550 324349883 1.07
tpch_q17/duckdb:vortex-compact 756647192 666479956 1.14
tpch_q18/duckdb:vortex-compact 568033815 555994814 1.02
tpch_q19/duckdb:vortex-compact 546322881 459571968 1.19
tpch_q20/duckdb:vortex-compact 778045241 760337195 1.02
tpch_q21/duckdb:vortex-compact 1059945400 1068915821 0.99
tpch_q22/duckdb:vortex-compact 313829818 289188348 1.09
duckdb / parquet (1.106x ➖, 0↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 514461951 487112029 1.06
tpch_q02/duckdb:parquet 1218534167 1113416560 1.09
tpch_q03/duckdb:parquet 1163037467 964562678 1.21
tpch_q04/duckdb:parquet 697941068 685468791 1.02
tpch_q05/duckdb:parquet 1401673203 1273467965 1.10
tpch_q06/duckdb:parquet 🚨 534673150 410812491 1.30
tpch_q07/duckdb:parquet 1344217786 1210338820 1.11
tpch_q08/duckdb:parquet 1757032265 1527896900 1.15
tpch_q09/duckdb:parquet 1484825420 1400891576 1.06
tpch_q10/duckdb:parquet 1379881088 1296883467 1.06
tpch_q11/duckdb:parquet 808164823 694482369 1.16
tpch_q12/duckdb:parquet 874862561 685784788 1.28
tpch_q13/duckdb:parquet 939667991 940761603 1.00
tpch_q14/duckdb:parquet 731545523 709398854 1.03
tpch_q15/duckdb:parquet 632990254 512039338 1.24
tpch_q16/duckdb:parquet 720844904 667922727 1.08
tpch_q17/duckdb:parquet 828367742 749518524 1.11
tpch_q18/duckdb:parquet 1033975611 863033944 1.20
tpch_q19/duckdb:parquet 918049993 816142926 1.12
tpch_q20/duckdb:parquet 1268729694 1286004755 0.99
tpch_q21/duckdb:parquet 1234411351 1120937017 1.10
tpch_q22/duckdb:parquet 564923122 590316339 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -12.7% -8.4% -4.7% +71.0% ➖ noise
1 datafusion:vortex-file-compressed +5.6% -8.4% +15.2% +67.9% ➖ noise
1 duckdb:vortex-compact -1.6% -8.4% +7.4% +38.5% ➖ noise
1 duckdb:vortex-file-compressed +0.5% -8.4% +9.7% +58.4% ➖ noise
2 datafusion:vortex-compact +10.5% +6.3% +4.0% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -29.5% +6.3% -33.7% +31.6% ✅ faster
2 duckdb:vortex-compact +11.4% +6.3% +4.8% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -3.0% +6.3% -8.7% +30.0% ➖ noise
3 datafusion:vortex-compact -15.7% +4.0% -19.0% +47.7% ➖ noise
3 datafusion:vortex-file-compressed -11.3% +4.0% -14.7% +51.9% ➖ noise
3 duckdb:vortex-compact +2.5% +4.0% -1.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +6.9% +4.0% +2.8% +34.0% ➖ noise
4 datafusion:vortex-compact +3.5% -4.7% +8.6% +45.5% ➖ noise
4 datafusion:vortex-file-compressed -14.7% -4.7% -10.5% +30.4% ➖ noise
4 duckdb:vortex-compact +1.8% -4.7% +6.8% +33.3% ➖ noise
4 duckdb:vortex-file-compressed -14.3% -4.7% -10.1% +30.0% ➖ noise
5 datafusion:vortex-compact -9.6% +3.7% -12.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +73.0% +3.7% +66.9% +35.9% 🚨 regression
5 duckdb:vortex-compact +13.3% +3.7% +9.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +15.5% +3.7% +11.4% +30.0% ➖ noise
6 datafusion:vortex-compact -21.0% +3.3% -23.5% +41.2% ➖ noise
6 datafusion:vortex-file-compressed -0.8% +3.3% -4.0% +30.0% ➖ noise
6 duckdb:vortex-compact +8.2% +3.3% +4.7% +36.3% ➖ noise
6 duckdb:vortex-file-compressed +4.9% +3.3% +1.5% +30.0% ➖ noise
7 datafusion:vortex-compact -33.3% +1.5% -34.3% +30.0% ✅ faster
7 datafusion:vortex-file-compressed -29.7% +1.5% -30.7% +30.0% ✅ faster
7 duckdb:vortex-compact +8.8% +1.5% +7.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +9.1% +1.5% +7.4% +30.0% ➖ noise
8 datafusion:vortex-compact -15.1% +1.3% -16.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -39.1% +1.3% -39.9% +66.2% ✅ faster
8 duckdb:vortex-compact +16.0% +1.3% +14.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -2.5% +1.3% -3.8% +30.0% ➖ noise
9 datafusion:vortex-compact -3.9% -1.2% -2.7% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -44.1% -1.2% -43.4% +36.3% ✅ faster
9 duckdb:vortex-compact +6.9% -1.2% +8.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +11.5% -1.2% +12.8% +30.0% ➖ noise
10 datafusion:vortex-compact -17.8% +6.6% -22.9% +36.6% ➖ noise
10 datafusion:vortex-file-compressed -10.2% +6.6% -15.8% +30.4% ➖ noise
10 duckdb:vortex-compact +9.9% +6.6% +3.1% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +4.7% +6.6% -1.8% +30.0% ➖ noise
11 datafusion:vortex-compact -27.0% +8.6% -32.8% +30.0% ✅ faster
11 datafusion:vortex-file-compressed -15.1% +8.6% -21.8% +35.2% ➖ noise
11 duckdb:vortex-compact +8.3% +8.6% -0.2% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +7.5% +8.6% -1.0% +30.0% ➖ noise
12 datafusion:vortex-compact -45.3% +4.8% -47.9% +40.5% ✅ faster
12 datafusion:vortex-file-compressed -0.9% +4.8% -5.4% +32.3% ➖ noise
12 duckdb:vortex-compact +16.1% +4.8% +10.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -5.4% +4.8% -9.7% +31.4% ➖ noise
13 datafusion:vortex-compact -30.2% +1.2% -31.0% +70.8% ➖ noise
13 datafusion:vortex-file-compressed +70.9% +1.2% +68.9% +57.3% 🚨 regression
13 duckdb:vortex-compact +9.9% +1.2% +8.6% +35.7% ➖ noise
13 duckdb:vortex-file-compressed +2.8% +1.2% +1.6% +30.0% ➖ noise
14 datafusion:vortex-compact -6.2% -11.4% +5.8% +32.6% ➖ noise
14 datafusion:vortex-file-compressed -6.4% -11.4% +5.7% +30.0% ➖ noise
14 duckdb:vortex-compact -7.4% -11.4% +4.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -3.9% -11.4% +8.5% +30.0% ➖ noise
15 datafusion:vortex-compact +9.8% +9.3% +0.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -1.1% +9.3% -9.5% +37.1% ➖ noise
15 duckdb:vortex-compact +12.1% +9.3% +2.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +2.2% +9.3% -6.5% +30.0% ➖ noise
16 datafusion:vortex-compact -0.5% +15.0% -13.5% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -1.5% +15.0% -14.3% +30.0% ➖ noise
16 duckdb:vortex-compact +7.4% +15.0% -6.6% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +22.5% +15.0% +6.6% +30.0% ➖ noise
17 datafusion:vortex-compact +3.9% +9.4% -5.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +18.1% +9.4% +8.0% +30.0% ➖ noise
17 duckdb:vortex-compact +13.5% +9.4% +3.8% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -11.2% +9.4% -18.8% +30.0% ➖ noise
18 datafusion:vortex-compact -16.4% +25.7% -33.5% +30.8% ✅ faster
18 datafusion:vortex-file-compressed +17.6% +25.7% -6.4% +44.2% ➖ noise
18 duckdb:vortex-compact +2.2% +25.7% -18.7% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +0.5% +25.7% -20.1% +30.0% ➖ noise
19 datafusion:vortex-compact -11.3% +0.3% -11.6% +42.7% ➖ noise
19 datafusion:vortex-file-compressed +38.6% +0.3% +38.2% +38.5% ➖ noise
19 duckdb:vortex-compact +18.9% +0.3% +18.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +5.8% +0.3% +5.4% +30.0% ➖ noise
20 datafusion:vortex-compact +0.7% +6.9% -5.8% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +8.8% +6.9% +1.8% +30.0% ➖ noise
20 duckdb:vortex-compact +2.3% +6.9% -4.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +6.2% +6.9% -0.6% +30.0% ➖ noise
21 datafusion:vortex-compact -0.4% +12.7% -11.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +12.8% +12.7% +0.2% +30.0% ➖ noise
21 duckdb:vortex-compact -0.8% +12.7% -12.0% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +5.5% +12.7% -6.4% +30.0% ➖ noise
22 datafusion:vortex-compact -2.7% +21.3% -19.8% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +37.5% +21.3% +13.4% +44.5% ➖ noise
22 duckdb:vortex-compact +8.5% +21.3% -10.5% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +9.3% +21.3% -9.9% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.000x ➖


unknown / unknown (0.999x ➖, 7↑ 3↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
compress time/Arade 1199288219 1185914920 1.01
compress time/Bimbo 7066779184 7040370334 1.00
compress time/CMSprovider 2950087774 2895418310 1.02
compress time/Euro2016 447335421 434868410 1.03
compress time/Food 391878776 377474562 1.04
compress time/HashTags 825182617 822433695 1.00
compress time/TPC-H l_comment canonical 1351104626 1295215889 1.04
compress time/TPC-H l_comment chunked 1330704143 1317267056 1.01
compress time/taxi 751657034 735176748 1.02
compress time/wide table cols=100 chunks=1 rows=1000 11654618 11895294 0.98
compress time/wide table cols=100 chunks=50 rows=1000 12435888 13649790 0.91
compress time/wide table cols=1000 chunks=1 rows=1000 129968613 126948823 1.02
compress time/wide table cols=1000 chunks=50 rows=1000 134073716 142016819 0.94
compress time/wide table cols=10000 chunks=1 rows=1000 1468214617 1431182077 1.03
compress time/wide table cols=10000 chunks=50 rows=1000 1482532598 1499958634 0.99
decompress time/Arade 26181588 27304806 0.96
decompress time/Bimbo 84153573 86453683 0.97
decompress time/CMSprovider 84042419 81713138 1.03
decompress time/Euro2016 19364286 17679300 1.10
decompress time/Food 🚀 8515309 10111566 0.84
decompress time/HashTags 74416148 76161117 0.98
decompress time/TPC-H l_comment canonical 41227766 40354784 1.02
decompress time/TPC-H l_comment chunked 41547128 40171013 1.03
decompress time/taxi 14989264 14970483 1.00
decompress time/wide table cols=100 chunks=1 rows=1000 2604952 2460403 1.06
decompress time/wide table cols=100 chunks=50 rows=1000 2710476 2801148 0.97
decompress time/wide table cols=1000 chunks=1 rows=1000 23784606 22946098 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 23665699 25945370 0.91
decompress time/wide table cols=10000 chunks=1 rows=1000 270970180 259074354 1.05
decompress time/wide table cols=10000 chunks=50 rows=1000 272183099 274438864 0.99
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2612458519 2564937515 1.02
parquet_rs-zstd compress time/Bimbo 12618507972 12659566314 1.00
parquet_rs-zstd compress time/CMSprovider 7059514259 6829134357 1.03
parquet_rs-zstd compress time/Euro2016 1309473802 1297898166 1.01
parquet_rs-zstd compress time/Food 800198728 791679745 1.01
parquet_rs-zstd compress time/HashTags 2243255146 2133958761 1.05
parquet_rs-zstd compress time/TPC-H l_comment canonical 3247400811 3136394532 1.04
parquet_rs-zstd compress time/TPC-H l_comment chunked 3204778439 3133372472 1.02
parquet_rs-zstd compress time/taxi 1207180472 1262822333 0.96
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6564055 6018478 1.09
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6728439 8045149 0.84
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 77576832 73216000 1.06
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 77736709 85952516 0.90
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 768884892 777779824 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 768586418 769476238 1.00
parquet_rs-zstd decompress time/Arade 623777928 616163154 1.01
parquet_rs-zstd decompress time/Bimbo 1700614252 1693059994 1.00
parquet_rs-zstd decompress time/CMSprovider 1745863026 1723798996 1.01
parquet_rs-zstd decompress time/Euro2016 383598112 378316926 1.01
parquet_rs-zstd decompress time/Food 198104072 197848131 1.00
parquet_rs-zstd decompress time/HashTags 🚨 697916382 626558001 1.11
parquet_rs-zstd decompress time/TPC-H l_comment canonical 607819931 588122798 1.03
parquet_rs-zstd decompress time/TPC-H l_comment chunked 600311787 586596565 1.02
parquet_rs-zstd decompress time/taxi 245930190 242674355 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2939434 2815453 1.04
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2899287 3353665 0.86
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34262559 31921519 1.07
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 34605027 38964215 0.89
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 346879273 378378734 0.92
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 349311639 344034437 1.02
vortex-file-compressed size/Arade 145363796 145363828 1.00
vortex-file-compressed size/Bimbo 468763332 468763364 1.00
vortex-file-compressed size/CMSprovider 417907812 417907844 1.00
vortex-file-compressed size/Euro2016 163394924 163497828 1.00
vortex-file-compressed size/Food 41926936 41926968 1.00
vortex-file-compressed size/HashTags 195647828 195647860 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087392 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087392 1.00
vortex-file-compressed size/taxi 52363948 52363980 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio compress time/Food 0 0 1.03
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.95
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio compress time/taxi 0 0 1.07
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.90
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.09
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.95
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.08
vortex:parquet-zstd ratio decompress time/Food 🚀 0 0 0.84
vortex:parquet-zstd ratio decompress time/HashTags 🚀 0 0 0.88
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.0%
Vortex (geomean): 0.974x ➖
Parquet (geomean): 1.015x ➖
Shifts: Parquet (control) +1.5% · Median polish +0.1%


datafusion / vortex-file-compressed (1.012x ➖, 0↑ 2↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 691694503 710564780 0.97
tpch_q02/datafusion:vortex-file-compressed 718778462 867857970 0.83
tpch_q03/datafusion:vortex-file-compressed 780013279 874140106 0.89
tpch_q04/datafusion:vortex-file-compressed 612323673 556287782 1.10
tpch_q05/datafusion:vortex-file-compressed 1002725142 1002834890 1.00
tpch_q06/datafusion:vortex-file-compressed 603035108 592675906 1.02
tpch_q07/datafusion:vortex-file-compressed 1036248752 1157236622 0.90
tpch_q08/datafusion:vortex-file-compressed 🚨 1713507737 1315779974 1.30
tpch_q09/datafusion:vortex-file-compressed 1657934970 1621997493 1.02
tpch_q10/datafusion:vortex-file-compressed 1280165491 1076906427 1.19
tpch_q11/datafusion:vortex-file-compressed 556415482 503548420 1.10
tpch_q12/datafusion:vortex-file-compressed 1098497719 1021540751 1.08
tpch_q13/datafusion:vortex-file-compressed 454849641 474279098 0.96
tpch_q14/datafusion:vortex-file-compressed 752661366 723821294 1.04
tpch_q15/datafusion:vortex-file-compressed 970940137 930971747 1.04
tpch_q16/datafusion:vortex-file-compressed 420746533 413228367 1.02
tpch_q17/datafusion:vortex-file-compressed 1221910927 1232609746 0.99
tpch_q18/datafusion:vortex-file-compressed 1212981671 1333191528 0.91
tpch_q19/datafusion:vortex-file-compressed 834892024 924019059 0.90
tpch_q20/datafusion:vortex-file-compressed 986564332 1121465444 0.88
tpch_q21/datafusion:vortex-file-compressed 1747002875 1952557331 0.89
tpch_q22/datafusion:vortex-file-compressed 🚨 562421701 395804755 1.42
datafusion / vortex-compact (0.935x ➖, 1↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 764189280 746780925 1.02
tpch_q02/datafusion:vortex-compact 941563392 1223613294 0.77
tpch_q03/datafusion:vortex-compact 839459459 822827422 1.02
tpch_q04/datafusion:vortex-compact 482172257 578529925 0.83
tpch_q05/datafusion:vortex-compact 857576653 975216252 0.88
tpch_q06/datafusion:vortex-compact 606282428 543675597 1.12
tpch_q07/datafusion:vortex-compact 987896249 1055073147 0.94
tpch_q08/datafusion:vortex-compact 1335727974 1052219830 1.27
tpch_q09/datafusion:vortex-compact 1276512697 1175475832 1.09
tpch_q10/datafusion:vortex-compact 945365087 822216437 1.15
tpch_q11/datafusion:vortex-compact 485047251 383358503 1.27
tpch_q12/datafusion:vortex-compact 815551992 842885228 0.97
tpch_q13/datafusion:vortex-compact 402265014 418631813 0.96
tpch_q14/datafusion:vortex-compact 496503569 600941559 0.83
tpch_q15/datafusion:vortex-compact 883392043 909857705 0.97
tpch_q16/datafusion:vortex-compact 324388391 435051156 0.75
tpch_q17/datafusion:vortex-compact 1128047562 1296165779 0.87
tpch_q18/datafusion:vortex-compact 1111966570 1343502613 0.83
tpch_q19/datafusion:vortex-compact 849951495 925391182 0.92
tpch_q20/datafusion:vortex-compact 975433403 989774104 0.99
tpch_q21/datafusion:vortex-compact 1568451510 1479868973 1.06
tpch_q22/datafusion:vortex-compact 🚀 409818024 845986259 0.48
datafusion / parquet (1.004x ➖, 1↑ 1↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 932618492 961873099 0.97
tpch_q02/datafusion:parquet 🚀 1098133178 1649559319 0.67
tpch_q03/datafusion:parquet 1158883042 1175483472 0.99
tpch_q04/datafusion:parquet 🚨 738949051 533285261 1.39
tpch_q05/datafusion:parquet 1230022851 1136517555 1.08
tpch_q06/datafusion:parquet 619736481 509603643 1.22
tpch_q07/datafusion:parquet 1420121580 1327637047 1.07
tpch_q08/datafusion:parquet 1956506127 1655197223 1.18
tpch_q09/datafusion:parquet 1944777963 1734530908 1.12
tpch_q10/datafusion:parquet 1947177842 2105509076 0.92
tpch_q11/datafusion:parquet 657251042 675661602 0.97
tpch_q12/datafusion:parquet 751761900 734010230 1.02
tpch_q13/datafusion:parquet 685313696 713344361 0.96
tpch_q14/datafusion:parquet 829338509 758892381 1.09
tpch_q15/datafusion:parquet 1365993592 1343748558 1.02
tpch_q16/datafusion:parquet 351568494 400325167 0.88
tpch_q17/datafusion:parquet 1423502822 1365378571 1.04
tpch_q18/datafusion:parquet 1499049719 2059192712 0.73
tpch_q19/datafusion:parquet 1019702724 907602471 1.12
tpch_q20/datafusion:parquet 1103298639 1267885699 0.87
tpch_q21/datafusion:parquet 1881160636 1985800764 0.95
tpch_q22/datafusion:parquet 867280063 786992190 1.10
duckdb / vortex-file-compressed (0.975x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 617361626 659885126 0.94
tpch_q02/duckdb:vortex-file-compressed 1133774269 1105333637 1.03
tpch_q03/duckdb:vortex-file-compressed 998664469 1085080979 0.92
tpch_q04/duckdb:vortex-file-compressed 798061457 836761734 0.95
tpch_q05/duckdb:vortex-file-compressed 1138180957 1165997182 0.98
tpch_q06/duckdb:vortex-file-compressed 690683798 573137664 1.21
tpch_q07/duckdb:vortex-file-compressed 1339244361 1299881447 1.03
tpch_q08/duckdb:vortex-file-compressed 1457553730 1383736806 1.05
tpch_q09/duckdb:vortex-file-compressed 1706290183 1763730440 0.97
tpch_q10/duckdb:vortex-file-compressed 1323673701 1207504210 1.10
tpch_q11/duckdb:vortex-file-compressed 665521125 700819395 0.95
tpch_q12/duckdb:vortex-file-compressed 1171639835 1342783219 0.87
tpch_q13/duckdb:vortex-file-compressed 921923429 998148590 0.92
tpch_q14/duckdb:vortex-file-compressed 653249584 672007351 0.97
tpch_q15/duckdb:vortex-file-compressed 513215299 567389082 0.90
tpch_q16/duckdb:vortex-file-compressed 436094941 425507492 1.02
tpch_q17/duckdb:vortex-file-compressed 984473287 1070265964 0.92
tpch_q18/duckdb:vortex-file-compressed 935016758 1072268105 0.87
tpch_q19/duckdb:vortex-file-compressed 770406452 784203786 0.98
tpch_q20/duckdb:vortex-file-compressed 1180181138 1270617375 0.93
tpch_q21/duckdb:vortex-file-compressed 2068059777 2170226797 0.95
tpch_q22/duckdb:vortex-file-compressed 432841373 410308305 1.05
duckdb / vortex-compact (0.976x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 597286242 602615220 0.99
tpch_q02/duckdb:vortex-compact 1036355994 987804759 1.05
tpch_q03/duckdb:vortex-compact 861079702 822831379 1.05
tpch_q04/duckdb:vortex-compact 587092401 613916734 0.96
tpch_q05/duckdb:vortex-compact 1112434377 1103551767 1.01
tpch_q06/duckdb:vortex-compact 543478654 546287513 0.99
tpch_q07/duckdb:vortex-compact 1082885831 1078486915 1.00
tpch_q08/duckdb:vortex-compact 1373423948 1501843529 0.91
tpch_q09/duckdb:vortex-compact 1569529031 1544306603 1.02
tpch_q10/duckdb:vortex-compact 1147569879 1288358864 0.89
tpch_q11/duckdb:vortex-compact 708881002 673287209 1.05
tpch_q12/duckdb:vortex-compact 1033146397 1198948896 0.86
tpch_q13/duckdb:vortex-compact 915948538 946049858 0.97
tpch_q14/duckdb:vortex-compact 656536847 695557192 0.94
tpch_q15/duckdb:vortex-compact 540976560 543326163 1.00
tpch_q16/duckdb:vortex-compact 428579387 403928331 1.06
tpch_q17/duckdb:vortex-compact 916065909 909902961 1.01
tpch_q18/duckdb:vortex-compact 750290887 814568082 0.92
tpch_q19/duckdb:vortex-compact 755471569 727505591 1.04
tpch_q20/duckdb:vortex-compact 1113406867 1224256343 0.91
tpch_q21/duckdb:vortex-compact 1712333557 1824149795 0.94
tpch_q22/duckdb:vortex-compact 437247797 465133899 0.94
duckdb / parquet (1.025x ➖, 0↑ 0↓)
name PR c6a1940 (ns) base 06cf4a3 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 931609665 881761969 1.06
tpch_q02/duckdb:parquet 1465234769 1361186394 1.08
tpch_q03/duckdb:parquet 1868485107 1738253596 1.07
tpch_q04/duckdb:parquet 1164915721 1037699410 1.12
tpch_q05/duckdb:parquet 1993242464 1985089409 1.00
tpch_q06/duckdb:parquet 881833963 853881849 1.03
tpch_q07/duckdb:parquet 2024380533 1753584207 1.15
tpch_q08/duckdb:parquet 2538996728 2413512758 1.05
tpch_q09/duckdb:parquet 2576788814 2618049504 0.98
tpch_q10/duckdb:parquet 3420818669 3193880018 1.07
tpch_q11/duckdb:parquet 1028002542 970751683 1.06
tpch_q12/duckdb:parquet 1117957534 1249177800 0.89
tpch_q13/duckdb:parquet 1345629087 1408434380 0.96
tpch_q14/duckdb:parquet 1262503290 1177994076 1.07
tpch_q15/duckdb:parquet 999674238 983349259 1.02
tpch_q16/duckdb:parquet 1031478651 957522980 1.08
tpch_q17/duckdb:parquet 1330580297 1222142542 1.09
tpch_q18/duckdb:parquet 1405432983 1621558953 0.87
tpch_q19/duckdb:parquet 1525453557 1476661985 1.03
tpch_q20/duckdb:parquet 2012202866 2069753408 0.97
tpch_q21/duckdb:parquet 1799890646 1846230187 0.97
tpch_q22/duckdb:parquet 1043461454 1087255853 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.3% +1.2% +1.1% +47.9% ➖ noise
1 datafusion:vortex-file-compressed -2.7% +1.2% -3.8% +48.9% ➖ noise
1 duckdb:vortex-compact -0.9% +1.2% -2.1% +40.5% ➖ noise
1 duckdb:vortex-file-compressed -6.4% +1.2% -7.6% +33.2% ➖ noise
2 datafusion:vortex-compact -23.1% -15.3% -9.1% +49.1% ➖ noise
2 datafusion:vortex-file-compressed -17.2% -15.3% -2.2% +41.1% ➖ noise
2 duckdb:vortex-compact +4.9% -15.3% +23.9% +32.2% ➖ noise
2 duckdb:vortex-file-compressed +2.6% -15.3% +21.2% +35.4% ➖ noise
3 datafusion:vortex-compact +2.0% +2.9% -0.9% +48.2% ➖ noise
3 datafusion:vortex-file-compressed -10.8% +2.9% -13.3% +47.7% ➖ noise
3 duckdb:vortex-compact +4.6% +2.9% +1.7% +39.3% ➖ noise
3 duckdb:vortex-file-compressed -8.0% +2.9% -10.6% +51.1% ➖ noise
4 datafusion:vortex-compact -16.7% +24.7% -33.2% +30.0% ✅ faster
4 datafusion:vortex-file-compressed +10.1% +24.7% -11.7% +30.0% ➖ noise
4 duckdb:vortex-compact -4.4% +24.7% -23.3% +30.0% ✅ faster
4 duckdb:vortex-file-compressed -4.6% +24.7% -23.5% +30.0% ✅ faster
5 datafusion:vortex-compact -12.1% +4.2% -15.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.0% +4.2% -4.1% +30.0% ➖ noise
5 duckdb:vortex-compact +0.8% +4.2% -3.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.4% +4.2% -6.4% +30.0% ➖ noise
6 datafusion:vortex-compact +11.5% +12.1% -0.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +1.7% +12.1% -9.2% +31.2% ➖ noise
6 duckdb:vortex-compact -0.5% +12.1% -11.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +20.5% +12.1% +7.5% +30.0% ➖ noise
7 datafusion:vortex-compact -6.4% +11.1% -15.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -10.5% +11.1% -19.4% +30.0% ➖ noise
7 duckdb:vortex-compact +0.4% +11.1% -9.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +3.0% +11.1% -7.3% +30.0% ➖ noise
8 datafusion:vortex-compact +26.9% +11.5% +13.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +30.2% +11.5% +16.8% +30.0% ➖ noise
8 duckdb:vortex-compact -8.6% +11.5% -18.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +5.3% +11.5% -5.5% +30.0% ➖ noise
9 datafusion:vortex-compact +8.6% +5.0% +3.4% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +2.2% +5.0% -2.7% +30.0% ➖ noise
9 duckdb:vortex-compact +1.6% +5.0% -3.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -3.3% +5.0% -7.9% +30.0% ➖ noise
10 datafusion:vortex-compact +15.0% -0.5% +15.5% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +18.9% -0.5% +19.4% +30.0% ➖ noise
10 duckdb:vortex-compact -10.9% -0.5% -10.5% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +9.6% -0.5% +10.1% +30.0% ➖ noise
11 datafusion:vortex-compact +26.5% +1.5% +24.7% +31.6% ➖ noise
11 datafusion:vortex-file-compressed +10.5% +1.5% +8.9% +32.5% ➖ noise
11 duckdb:vortex-compact +5.3% +1.5% +3.7% +36.3% ➖ noise
11 duckdb:vortex-file-compressed -5.0% +1.5% -6.4% +30.0% ➖ noise
12 datafusion:vortex-compact -3.2% -4.3% +1.1% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +7.5% -4.3% +12.3% +30.0% ➖ noise
12 duckdb:vortex-compact -13.8% -4.3% -10.0% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -12.7% -4.3% -8.9% +30.0% ➖ noise
13 datafusion:vortex-compact -3.9% -4.2% +0.3% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -4.1% -4.2% +0.1% +32.9% ➖ noise
13 duckdb:vortex-compact -3.2% -4.2% +1.1% +37.4% ➖ noise
13 duckdb:vortex-file-compressed -7.6% -4.2% -3.6% +35.3% ➖ noise
14 datafusion:vortex-compact -17.4% +8.2% -23.7% +30.0% ✅ faster
14 datafusion:vortex-file-compressed +4.0% +8.2% -3.9% +36.9% ➖ noise
14 duckdb:vortex-compact -5.6% +8.2% -12.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -2.8% +8.2% -10.2% +30.0% ➖ noise
15 datafusion:vortex-compact -2.9% +1.7% -4.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +4.3% +1.7% +2.6% +30.0% ➖ noise
15 duckdb:vortex-compact -0.4% +1.7% -2.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -9.5% +1.7% -11.0% +30.0% ➖ noise
16 datafusion:vortex-compact -25.4% -2.7% -23.3% +31.9% ➖ noise
16 datafusion:vortex-file-compressed +1.8% -2.7% +4.7% +44.5% ➖ noise
16 duckdb:vortex-compact +6.1% -2.7% +9.1% +36.5% ➖ noise
16 duckdb:vortex-file-compressed +2.5% -2.7% +5.4% +30.0% ➖ noise
17 datafusion:vortex-compact -13.0% +6.5% -18.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -0.9% +6.5% -7.0% +30.0% ➖ noise
17 duckdb:vortex-compact +0.7% +6.5% -5.5% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -8.0% +6.5% -13.7% +30.0% ➖ noise
18 datafusion:vortex-compact -17.2% -20.6% +4.2% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -9.0% -20.6% +14.5% +30.0% ➖ noise
18 duckdb:vortex-compact -7.9% -20.6% +16.0% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -12.8% -20.6% +9.8% +30.0% ➖ noise
19 datafusion:vortex-compact -8.2% +7.7% -14.7% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -9.6% +7.7% -16.1% +30.0% ➖ noise
19 duckdb:vortex-compact +3.8% +7.7% -3.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -1.8% +7.7% -8.8% +30.0% ➖ noise
20 datafusion:vortex-compact -1.4% -8.0% +7.1% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -12.0% -8.0% -4.4% +30.0% ➖ noise
20 duckdb:vortex-compact -9.1% -8.0% -1.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -7.1% -8.0% +1.0% +30.0% ➖ noise
21 datafusion:vortex-compact +6.0% -3.9% +10.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -10.5% -3.9% -6.9% +30.0% ➖ noise
21 duckdb:vortex-compact -6.1% -3.9% -2.3% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -4.7% -3.9% -0.8% +30.0% ➖ noise
22 datafusion:vortex-compact -51.6% +2.8% -52.9% +51.4% ✅ faster
22 datafusion:vortex-file-compressed +42.1% +2.8% +38.2% +37.0% 🚨 regression
22 duckdb:vortex-compact -6.0% +2.8% -8.6% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +5.5% +2.8% +2.6% +30.0% ➖ noise

@mhk197 mhk197 added the changelog/performance A performance improvement label May 21, 2026
@mhk197 mhk197 force-pushed the mk/explicit-listview-compaction branch from f8b4f2e to 933bdc1 Compare May 21, 2026 16:34
@mhk197 mhk197 marked this pull request as ready for review May 21, 2026 16:38
@mhk197 mhk197 linked an issue May 21, 2026 that may be closed by this pull request
Comment thread vortex-array/src/arrays/listview/rebuild.rs Outdated
Comment thread vortex-array/src/arrays/listview/array.rs Outdated
Comment thread vortex-array/src/arrays/listview/array.rs Outdated
Comment thread vortex-array/src/arrays/listview/array.rs Outdated
Comment thread vortex-array/src/arrays/listview/array.rs Outdated
@mhk197 mhk197 force-pushed the mk/explicit-listview-compaction branch from ad614a7 to 7490746 Compare May 21, 2026 20:00
@mhk197 mhk197 requested a review from connortsui20 May 21, 2026 20:03
Matt Katz and others added 13 commits May 21, 2026 16:05
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Signed-off-by: Matthew Katz <katz@spiraldb.com>
@mhk197 mhk197 force-pushed the mk/explicit-listview-compaction branch from 57908ab to cd7c97e Compare May 21, 2026 20:05
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks. good overall

did you do this for duckdb too? that is important. since that might be passed sparse element lists.

also a single definitive comment explaining what you did.

Comment thread vortex-array/src/arrays/listview/array.rs Outdated
Comment thread vortex-array/src/arrays/listview/array.rs Outdated
Comment thread vortex-array/src/arrays/listview/rebuild.rs Outdated
Comment thread vortex-array/src/arrays/listview/rebuild.rs Outdated
Comment thread vortex-array/src/arrow/executor/list_view.rs Outdated
Comment thread vortex-array/src/arrays/listview/rebuild.rs Outdated
Comment thread vortex-array/src/arrays/listview/array.rs Outdated
Signed-off-by: Matthew Katz <katz@spiraldb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Defer ListViewArray compaction and improve rebuild heuristic

3 participants